-- Logs begin at Tue 2021-05-25 14:59:02 UTC, end at Tue 2021-05-25 15:58:24 UTC. -- May 25 15:31:36.923648 dv-cinder-791239-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 15:31:36.935921 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 15:31:36.937916 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 25 15:31:36 2021] *** May 25 15:31:36.937916 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 15:31:36.937916 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 15:31:36.937916 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: nodename: dv-cinder-791239-3-iscsi May 25 15:31:36.937916 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: machine: x86_64 May 25 15:31:36.937916 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: clock source: unix May 25 15:31:36.937916 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: pcre jit disabled May 25 15:31:36.937916 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: detected number of CPU cores: 4 May 25 15:31:36.937916 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: current working directory: / May 25 15:31:36.937916 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: detected binary path: /usr/bin/uwsgi-core May 25 15:31:36.938579 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: your processes number limit is 47680 May 25 15:31:36.938579 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: your memory page size is 4096 bytes May 25 15:31:36.938579 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: detected max file descriptor number: 2048 May 25 15:31:36.938579 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: lock engine: pthread robust mutexes May 25 15:31:36.938579 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: thunder lock: enabled May 25 15:31:36.938579 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 15:31:36.938579 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 25 15:31:36.978487 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: Python main interpreter initialized at 0x55d35108d9c0 May 25 15:31:36.978487 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: python threads support enabled May 25 15:31:36.978487 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: your server socket listen backlog is limited to 100 connections May 25 15:31:36.978487 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: your mercy for graceful operations on workers is 90 seconds May 25 15:31:36.978860 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: mapped 403077 bytes (393 KB) for 2 cores May 25 15:31:36.978938 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: *** Operational MODE: preforking *** May 25 15:31:36.979155 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: *** uWSGI is running in multiple interpreter mode *** May 25 15:31:36.979155 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: spawned uWSGI master process (pid: 97735) May 25 15:31:36.979345 dv-cinder-791239-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 15:31:36.979906 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: spawned uWSGI worker 1 (pid: 97736, cores: 1) May 25 15:31:36.980253 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: spawned uWSGI worker 2 (pid: 97737, cores: 1) May 25 15:31:36.982340 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 15:31:38.590558 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:31:38.590558 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: from cryptography.utils import int_from_bytes May 25 15:31:38.591236 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:31:38.591236 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: from cryptography.utils import int_from_bytes May 25 15:31:38.591690 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:31:38.591690 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: from cryptography.utils import int_from_bytes May 25 15:31:38.591829 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:31:38.591829 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: from cryptography.utils import int_from_bytes May 25 15:31:41.208993 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:31:41.209593 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:31:41.209688 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:31:41.209688 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:31:41.210101 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:31:41.210101 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:31:41.210233 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:31:41.210303 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:31:41.210426 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:31:41.210636 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.210750 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:31:41.210972 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.211067 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.211299 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.211381 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.211624 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.211716 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.211988 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.212077 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.212309 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.212405 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.212637 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.212729 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.212965 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.213048 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.213298 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.213382 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.213566 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.213648 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.213884 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.213966 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.214207 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.214291 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-791239-3-iscsi {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.214534 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.214620 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-791239-3-iscsi {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.214847 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.214935 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.215162 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.215245 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.215482 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.215570 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.215793 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.215901 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.216132 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.216216 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.216454 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.216535 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.216770 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.216961 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.217390 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.217528 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.217632 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.217733 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.217887 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.217999 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.218203 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.218374 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.218545 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.218670 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.218866 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.218951 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.219184 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.219265 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.219510 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.219592 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.219826 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.219942 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.220184 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.220268 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.220501 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.220583 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-791239-3-iscsi {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.220904 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-791239-3-iscsi {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.221056 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.221248 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.221330 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.221566 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.221696 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.221887 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.221969 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.222285 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.222370 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.222600 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.222702 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.222917 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.222998 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.223243 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.223323 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.223561 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.223695 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.223893 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.224004 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.224235 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.224351 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.224559 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.224661 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.224882 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.224979 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.225189 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.225279 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.225504 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.225604 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.225815 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.225905 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.226131 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.226223 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.226439 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.226529 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.226750 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.226841 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.227010 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.227107 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.227324 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.227416 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.227657 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.227747 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.228011 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.228103 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.228345 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.228440 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.228607 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.228740 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.228864 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.229034 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.229191 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.229283 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.229519 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.229603 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.229835 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.229920 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.230151 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.230235 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.230465 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.230548 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.230776 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.230860 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.231086 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.231178 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.231398 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.231517 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.231708 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.231792 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.232042 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.232140 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.232365 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.232472 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.232686 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.232778 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.233014 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.233108 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.233331 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.233414 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.233655 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.233845 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.233983 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.234262 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.234392 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.234523 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.234652 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.234839 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.234966 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.235186 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.235312 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.235513 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.235639 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.235831 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.235979 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.236184 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.236312 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.236515 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.236630 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.237360 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.237459 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.237676 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.237767 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.237990 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.238081 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.238324 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.238408 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.238657 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.238752 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.238969 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.239053 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.239228 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.239319 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.239536 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.239625 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.239846 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.239965 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.240195 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.240276 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.240507 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.240604 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.240816 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.240906 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.241127 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.241217 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.241431 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.241522 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.241740 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.241823 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.242054 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.242135 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.242362 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.242452 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.242672 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.242760 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.242983 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.243125 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.243289 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.243372 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.243598 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.243679 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.243930 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.244029 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.244245 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.244330 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.244570 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.244652 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.244895 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.244988 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.245206 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.245290 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.245515 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.245597 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.245824 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.245904 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.246137 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.246234 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.246460 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.246556 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.246769 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.246851 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.247079 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.247163 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.247405 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.247540 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.247715 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.247805 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.248048 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.248133 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.248375 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.248459 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.248688 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.248769 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.248997 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.249088 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.249320 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.249403 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.249624 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.249705 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.249933 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.250023 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.250254 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.250335 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.250564 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.250646 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.250873 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.250956 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.251180 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.251263 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.251489 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.251831 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.252075 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.252159 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.252432 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.253041 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.253268 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.253372 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.253582 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.253666 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.253891 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.253972 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.254217 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.254311 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.254547 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.254630 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.254860 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.254942 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.255171 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.255266 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.255485 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.255573 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.255809 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.255910 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:41.256175 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.256259 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.256512 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.256600 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.256861 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.256943 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.257177 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.257260 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.257518 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.257604 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.257855 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.257936 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.258181 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.258272 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.258499 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.258581 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.258821 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.258903 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.259152 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.259235 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.259472 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.259553 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.259790 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.259927 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.260134 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.260219 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.260459 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.260540 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.260785 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.260885 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.261121 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.261223 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.261445 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.261534 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.261771 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.261866 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.262100 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.262182 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.262421 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.262504 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.262749 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.262882 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.263088 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.263172 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.263413 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.263495 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.263731 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.263825 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.264106 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.264243 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.264454 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.264537 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.264772 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.264870 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.265105 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.265201 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.265421 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.265513 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.265751 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.265842 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.266070 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.266152 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.266387 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.266475 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.266704 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.266788 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.267029 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.267111 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.267349 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.267431 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.267665 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.267754 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.268052 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.268155 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.268379 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.268462 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.268700 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.268783 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.269011 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.269093 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.269326 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.269416 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.269637 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.269721 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.269954 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.270044 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.270263 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.270355 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.270589 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.270678 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.270920 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.271003 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.271234 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.271328 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.271574 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.271656 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.271904 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.272001 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.272226 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.272318 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.272542 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.272624 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.272854 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.272936 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.273170 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.273261 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.273488 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.273579 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.273801 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.273890 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.274131 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.274223 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.274448 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.274532 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.274757 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.274845 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.275085 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.275178 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.275392 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.275484 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.275703 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.275787 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.277237 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.277338 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.277408 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.277408 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.277531 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.277597 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.277671 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.277671 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.277927 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.278149 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.278259 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.278514 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.278658 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.278809 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.278943 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.279144 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.279272 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.279488 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.279622 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.279808 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.279974 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.280170 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.280297 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.280506 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.280633 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.280879 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.281142 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.281273 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.281412 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.281555 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.281687 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.281819 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.281946 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.282101 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.282228 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.282446 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.282618 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.282743 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.282871 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.283010 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.283137 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.283316 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.283444 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.284183 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.284324 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.284464 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.284601 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.284783 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.284910 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.285109 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.285202 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.285423 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.285520 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.285736 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.285818 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.286048 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.286137 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.286359 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.286450 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.286700 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.286783 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.287011 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.287093 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.287348 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.287440 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.287668 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.287763 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.288022 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.288109 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.288346 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.288438 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.288662 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.288745 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.288972 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.289053 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.289283 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.289367 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.289604 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.289695 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.289914 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.289997 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.290234 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.290326 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.290548 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.290631 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.290858 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.290940 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.291180 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.291272 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.291511 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.291595 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.291824 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.291949 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.292169 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.292263 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.292487 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.292569 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.292803 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.292899 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.293122 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.293207 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.293438 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.293520 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.293749 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.293839 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.294060 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.294143 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.294373 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.294456 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.294693 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.294784 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.295015 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.295115 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.295329 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.295412 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.295639 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.295730 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.295978 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.296064 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.296295 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.296392 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.296607 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.296699 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.296917 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.297006 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.297229 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.297313 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.297552 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.297637 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.297867 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.297956 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.298196 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.298278 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.298526 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.298611 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.298839 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.298922 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.299152 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.299234 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.300029 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.300116 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.300360 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.300451 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.300676 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.300760 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.300989 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.301078 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.301301 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.301398 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.301603 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.301692 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.301948 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.302069 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.302260 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.302350 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.302569 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.302661 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.302897 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.302981 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.303211 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.303299 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.303529 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.303620 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.303846 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.303949 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.304186 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.304270 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.304502 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.304601 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.304826 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.304909 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.305142 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.305233 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.305458 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.305550 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.305773 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.305854 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.306089 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.306170 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.306403 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.306487 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.306719 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.306800 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.307035 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.307125 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.307352 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.307437 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.307669 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.307751 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.308001 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.308089 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.308323 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.308408 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.308640 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.308715 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.308965 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.309219 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.309538 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.309623 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.309866 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.309954 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.310187 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.310283 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.310509 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.310591 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.310834 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.310915 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.311163 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.311256 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.311493 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.311576 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.311817 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.311914 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.312158 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.312255 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.312472 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.312561 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.312783 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.312864 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.313095 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.313250 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.313408 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.313492 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.313716 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.313805 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.314029 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.314113 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.314338 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.314420 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.314647 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.314776 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.314980 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.315064 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.315291 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.315373 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.315600 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.315682 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.315936 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.316036 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.316252 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.316334 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.316562 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.316652 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.316876 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.316972 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.317185 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.317268 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.317498 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.317586 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.317822 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.317905 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.318134 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.318216 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.318444 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.318534 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.318818 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.318914 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.319066 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.319149 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.319396 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.319488 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.319720 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.319801 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.320090 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.320175 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.320430 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.320524 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.320740 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.320822 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.321053 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.321136 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.321382 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.321472 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.321691 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.321772 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.322003 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.322094 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.322314 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.322398 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.322624 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.322714 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.322936 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.323017 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.323246 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.323331 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.323555 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.323645 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.323904 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.324004 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.324215 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.324300 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.324528 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.324624 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.324837 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.324920 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.325145 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.325233 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.325459 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.325551 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.325766 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.325850 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.326077 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.326159 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.326388 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.326479 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.326702 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.326785 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.327017 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.327100 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.327326 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.327410 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.327635 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.327725 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.327983 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.328067 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.328297 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.328383 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.328618 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.328707 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.328931 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.329045 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.329242 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.329346 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.329551 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.329633 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.329870 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.329955 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.330189 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.330276 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.330521 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.330604 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.330835 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.330930 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.331144 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.331227 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.331454 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.331538 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.331764 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.331907 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.332100 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.332185 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.332406 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.332503 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.332715 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.332807 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.333022 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.333104 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.333329 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.333418 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.333639 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.333730 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.333951 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.334041 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.334267 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.334365 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.334578 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.334670 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.334889 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.334978 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.335194 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.335276 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.335504 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.335587 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.335837 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.335982 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.336188 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.336278 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.336525 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.336615 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.336846 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.336930 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.337166 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.337255 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.337481 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.337568 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.337799 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.337880 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.338115 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.338196 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.338428 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.338520 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.338741 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.338823 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.339060 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.339162 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.339373 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.339456 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.339684 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.339775 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.340017 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.340119 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.340328 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.340411 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.340652 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.340736 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.340971 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.341062 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.341291 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.341381 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.341627 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.341960 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.342060 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.342296 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.342411 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.342611 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.342711 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.342927 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.343025 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.343245 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.343336 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.343560 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.343650 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.343894 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.344006 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.344219 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.344303 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.344538 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.344621 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.344856 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.344938 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.345175 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.345247 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.345666 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.346881 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.346881 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.347038 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.347123 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.347206 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.347206 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.347355 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.347432 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.347520 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.347598 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.347673 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.347877 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.347963 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.348209 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.348306 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.348523 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.348605 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.348841 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.348930 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.349159 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.349256 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.349477 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.349563 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.349790 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.349871 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.350224 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.350309 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.350542 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.350624 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.350859 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.350948 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.351172 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.351255 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.351488 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.351569 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.351805 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.351907 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.352154 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.352246 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.352476 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.352626 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.352788 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.352871 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.353217 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.353307 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.353533 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.353615 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.353851 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.353946 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.354167 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.354250 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.354478 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.354560 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.354786 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.354877 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.355103 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.355185 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.355431 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.355513 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.355745 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.355836 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.356083 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.356166 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.356395 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.356477 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.356724 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.356817 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.357035 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.357117 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.357363 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.357445 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.357790 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.357875 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.358109 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.358191 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.358423 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.358513 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.358846 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.358936 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.359243 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.359339 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.359485 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.359568 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.359813 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.359914 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.360168 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.360252 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.360502 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.360584 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.360811 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.360896 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.361134 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.361216 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.361449 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.361541 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.362345 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.362437 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.362693 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.362855 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.363017 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.363188 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.363345 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.363515 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.363662 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.363829 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.364019 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.364188 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.364355 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.364523 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.364680 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.364845 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.365014 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.365205 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.365441 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.365605 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.365775 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.365940 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.366097 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.366262 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.366427 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.366593 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.366763 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.366928 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.367081 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.367244 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.367395 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.367558 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.367717 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.367897 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.368069 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.368218 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.368387 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.368534 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.368721 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.368865 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.369022 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.369188 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.369358 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.369509 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.369659 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.369827 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.369979 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.370143 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.370294 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.370457 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.370606 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.370768 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.370940 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.371227 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.371325 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.371402 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.371572 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.371727 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.371915 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.372076 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.372252 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.372409 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.372584 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.372737 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.372902 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.373051 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.373236 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.373383 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.373556 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.373701 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.373871 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.374013 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.374184 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.374325 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.374497 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.374637 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.374847 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.374984 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.375160 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.375294 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.375491 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.375622 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.375831 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.376018 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.376191 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.376360 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.376765 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.376943 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.377116 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.377284 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.377963 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.378131 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.378291 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.378455 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.378616 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.378780 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.378951 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.379118 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.379266 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.379467 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.379573 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.379741 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.379906 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.380086 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.380225 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.380399 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.380561 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.380713 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.380839 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.381024 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.381158 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.381340 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.381470 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.381652 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.381783 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.381961 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.382090 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.382271 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.382421 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.382602 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.382734 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.382917 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.383064 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.383248 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.383381 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.383568 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.383695 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.383938 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.384027 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.384217 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.384337 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.384529 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.384689 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.384879 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.385001 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.385190 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.385341 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.385531 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.385667 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.385853 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.385991 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.386184 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.386320 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.386522 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.386640 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.386840 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.386972 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.387171 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.387298 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.387496 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.387622 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.387820 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.387974 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.388164 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.388302 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.388487 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.388625 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.388811 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.388950 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.389141 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.389275 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.389463 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.389666 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.389782 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.389907 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.390104 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.390232 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.390423 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.390560 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.390749 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.391091 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.391280 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.391429 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.391617 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.391753 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.391965 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.392106 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.392290 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.392430 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.392611 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.392760 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.392939 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.393622 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.393809 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.393957 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.394131 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.394278 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.394451 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.394599 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.394770 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.394921 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.395089 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.395259 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.395425 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.395594 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.395760 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.395972 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.396114 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.396325 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.396462 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.396651 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.396788 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.396975 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.397111 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.397301 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.397434 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.397628 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.397761 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.398001 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.398129 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.398329 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.398456 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.398646 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.398771 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.398972 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.399104 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.399300 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.399432 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.399629 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.399764 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.400070 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.400176 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.400399 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.400492 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.400727 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.400813 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.401057 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.401143 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.401386 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.401470 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.401703 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.401795 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.402026 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.402110 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.402349 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.402433 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.402684 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.402775 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.403030 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.403153 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.403358 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.403442 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.403676 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.403768 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.404020 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.404119 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.404343 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.404434 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.404871 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.404955 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.405195 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.405277 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.405537 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.405620 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.405874 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.405959 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.406208 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.406292 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.406533 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.406623 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.406859 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.406944 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.407193 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.407282 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.407505 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.407587 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.407818 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.407927 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.408160 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.408243 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.408478 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.408575 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.408816 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.408901 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.409150 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.409235 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.409469 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.409560 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.409780 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.409876 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.410109 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.410211 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.410420 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.410517 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.410959 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.411042 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.411317 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.411401 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.411644 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.411802 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.412008 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.412107 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.412345 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.412441 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.412668 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.412760 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.412982 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.413072 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.413314 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.413396 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.413625 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.413709 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.413937 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.414020 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.414260 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.414343 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.414576 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.414661 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.414888 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.414970 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.415196 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.415278 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.415511 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.415602 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.415827 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.415969 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.416163 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.416286 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.416479 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.416572 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.416789 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.416872 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.417122 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.417214 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.417433 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.417522 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.417746 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.417838 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.418058 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.418149 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.418375 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.418457 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.418687 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.418777 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.419001 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.419093 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.419308 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.419391 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.419618 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.419707 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.419961 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.420078 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.420273 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.420360 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.420589 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.420750 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.420901 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.421074 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.421221 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.421394 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.421535 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.421709 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.421852 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.422028 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.422166 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.422342 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.422675 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.422853 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.422992 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.423176 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.423306 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.423495 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.423630 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.423824 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.423973 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.424174 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.424330 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.424538 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.424655 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.424863 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.424977 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.425186 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.425333 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.425547 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.425660 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.425876 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.426202 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.426418 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.426546 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.426764 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.426877 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.427095 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.427229 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.427450 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.427582 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.427802 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.427920 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.428148 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.428242 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.428466 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.428551 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.428784 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.428867 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.429122 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.429207 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.429444 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.429527 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.429766 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.429849 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.430084 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.430175 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.430399 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.430484 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.430716 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.430808 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.431032 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.431115 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.431348 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.431431 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.431663 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.431754 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.432007 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.432093 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.432330 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.432413 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.432669 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.432764 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.432995 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.433077 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.433317 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.433399 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.433639 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.433730 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.433956 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.434047 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.434274 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.434356 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.434590 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.434674 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.434905 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.434988 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.435223 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.435308 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.435549 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.435634 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.435891 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.435978 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.436208 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.436291 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.436522 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.436636 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.436950 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.437034 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.437274 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.437365 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.437602 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.437686 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.437924 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.438007 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.438239 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.438330 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.438595 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.438679 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.438937 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.439020 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.439273 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.439364 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.439585 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.439667 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.440479 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.440578 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.440774 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.440861 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.441089 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.441173 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.441409 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.441493 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.441759 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.441846 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.442084 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.442176 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.442413 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.442496 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.442743 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.442830 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.443066 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.443149 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.443389 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.443475 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.443706 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.443790 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.444050 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.444137 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.444369 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.444457 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.444689 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.444775 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.445004 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.445086 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.445319 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.445411 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.445636 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.445726 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.445953 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.446062 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.446272 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.446365 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.446587 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.446670 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.446897 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.446987 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.447212 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.447304 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.447534 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.447618 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.447853 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.447958 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.448211 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.448308 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.448533 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.448616 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.448915 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.449000 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.449177 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.449260 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.449504 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.449577 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.449820 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.449904 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.450142 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.450225 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.450470 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.450566 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.450797 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.450894 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.451113 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.451208 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.451428 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.451512 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.451758 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.451841 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.452102 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.452197 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.452421 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.452506 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.452741 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.452832 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.453057 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.453141 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.453376 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.453459 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.453699 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.453837 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.454030 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.454120 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.454345 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.454437 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.454661 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.454753 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.454990 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.455074 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.455311 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.455394 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.456220 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.456329 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.456533 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.456616 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.456855 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.456938 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.457181 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.457264 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.457502 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.457585 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.457818 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.457900 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.458136 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.458220 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.458454 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.458545 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.458777 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.458859 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.459145 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.459236 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.459436 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.459518 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.459767 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.459880 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.460125 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.460219 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.460457 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.460540 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.460789 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.460912 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.461121 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.461265 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.461462 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.461546 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.461712 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=97737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:31:41.461806 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:41.462031 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=97736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:31:41.494651 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG oslo_db.sqlalchemy.engines [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:31:41.495341 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_db.sqlalchemy.engines [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:31:41.739168 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.context [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d361204-4d46-4b6e-978b-1951a5dab06b(cell1) {{(pid=97736) load_cells /opt/stack/nova/nova/context.py:464}} May 25 15:31:41.739390 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.context [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d361204-4d46-4b6e-978b-1951a5dab06b(cell1) {{(pid=97737) load_cells /opt/stack/nova/nova/context.py:464}} May 25 15:31:41.743470 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_concurrency.lockutils [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:31:41.743595 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG oslo_concurrency.lockutils [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:31:41.745133 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_concurrency.lockutils [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:31:41.745295 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG oslo_concurrency.lockutils [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:31:41.745964 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_concurrency.lockutils [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:31:41.746104 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG oslo_concurrency.lockutils [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:31:41.747959 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_concurrency.lockutils [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:31:41.748086 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG oslo_concurrency.lockutils [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:31:41.779881 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_db.sqlalchemy.engines [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:31:41.780690 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_db.sqlalchemy.engines [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:31:41.783064 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG oslo_db.sqlalchemy.engines [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:31:41.784172 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG oslo_db.sqlalchemy.engines [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:31:41.818704 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG oslo_db.sqlalchemy.engines [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:31:41.820440 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_db.sqlalchemy.engines [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:31:42.253784 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: WARNING keystonemiddleware.auth_token [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:31:42.256569 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: WARNING keystonemiddleware.auth_token [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:31:42.260214 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: WARNING keystonemiddleware.auth_token [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:31:42.263027 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: WARNING keystonemiddleware.auth_token [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:31:42.487917 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: WARNING keystonemiddleware.auth_token [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:31:42.493024 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: WARNING keystonemiddleware.auth_token [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:31:42.494924 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: WARNING keystonemiddleware.auth_token [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:31:42.498288 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d35108d9c0 pid: 97737 (default app) May 25 15:31:42.500112 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: WARNING keystonemiddleware.auth_token [None req-e679b9e1-3695-4d91-bedf-68b11dffd79e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:31:42.500400 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:31:42.501515 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001662 May 25 15:31:42.502191 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 789 bytes} [Tue May 25 15:31:42 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:31:42.506234 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d35108d9c0 pid: 97736 (default app) May 25 15:33:01.839418 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:01.840457 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 May 25 15:33:01.841029 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:33:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:33:02.430986 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-fe0a0838-990d-46b3-8bfa-c8b804b1ec10 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:02.458093 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-fe0a0838-990d-46b3-8bfa-c8b804b1ec10 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.610046 May 25 15:33:02.458833 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1291 bytes} [Tue May 25 15:33:01 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:33:04.607144 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:04.608073 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-81e14c27-54d8-497c-898d-63e6d87d3b7b None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 25 15:33:04.608713 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:33:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:33:04.670476 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-7b7a3916-a816-4525-92c5-2e101f64e07a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256}} {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:04.690466 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:33:04.690466 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: warnings.warn(msg) May 25 15:33:04.718490 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-7b7a3916-a816-4525-92c5-2e101f64e07a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102831 May 25 15:33:04.719221 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1282 bytes} [Tue May 25 15:33:04 2021] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:33:05.059814 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-a9ae7860-fbf4-4735-ae07-daf8a057eb82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:05.062335 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:33:05.062335 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: warnings.warn(msg) May 25 15:33:05.109040 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-a9ae7860-fbf4-4735-ae07-daf8a057eb82 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.381907 May 25 15:33:05.121109 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1335 bytes} [Tue May 25 15:33:04 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:33:07.245395 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-7b7a3916-a816-4525-92c5-2e101f64e07a admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:07.246524 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-7b7a3916-a816-4525-92c5-2e101f64e07a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 May 25 15:33:07.246997 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:33:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:33:07.359456 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-60525e4d-f964-407a-9081-f7709f1e8ed0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:07.378991 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:33:07.378991 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: warnings.warn(msg) May 25 15:33:07.404416 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-60525e4d-f964-407a-9081-f7709f1e8ed0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150463 May 25 15:33:07.404998 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1282 bytes} [Tue May 25 15:33:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:33:07.416894 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-f3fedb8f-f8f4-4d8e-a925-045345a2e433 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:07.418442 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:33:07.418442 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: warnings.warn(msg) May 25 15:33:07.457395 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-f3fedb8f-f8f4-4d8e-a925-045345a2e433 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044200 May 25 15:33:07.458171 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1335 bytes} [Tue May 25 15:33:07 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:33:09.593406 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-60525e4d-f964-407a-9081-f7709f1e8ed0 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:09.594444 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-60525e4d-f964-407a-9081-f7709f1e8ed0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 25 15:33:09.594877 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:33:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:33:09.652510 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-de62321d-3474-44be-9099-9a82198d9672 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "disk": 10, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1}} {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:09.679955 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-de62321d-3474-44be-9099-9a82198d9672 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078591 May 25 15:33:09.680536 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1282 bytes} [Tue May 25 15:33:09 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:33:09.692434 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-d39e8f5c-f4d5-4169-b06c-7953f7047e87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:09.733637 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-d39e8f5c-f4d5-4169-b06c-7953f7047e87 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045343 May 25 15:33:09.734577 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1335 bytes} [Tue May 25 15:33:09 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:33:11.873895 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-de62321d-3474-44be-9099-9a82198d9672 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:11.875209 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-de62321d-3474-44be-9099-9a82198d9672 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 25 15:33:11.875611 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:33:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:33:11.934043 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-68ba37fc-f28d-4210-8409-eb424779a567 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "ram": 2048}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:11.958993 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-68ba37fc-f28d-4210-8409-eb424779a567 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076391 May 25 15:33:11.959924 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1282 bytes} [Tue May 25 15:33:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:33:11.971534 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-d9d1d157-e31c-4bf3-b63b-02a3c9bbe4b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:12.009871 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-d9d1d157-e31c-4bf3-b63b-02a3c9bbe4b4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041990 May 25 15:33:12.010464 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1335 bytes} [Tue May 25 15:33:11 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:33:14.164147 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-68ba37fc-f28d-4210-8409-eb424779a567 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:14.165159 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-68ba37fc-f28d-4210-8409-eb424779a567 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 25 15:33:14.165544 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:33:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:33:14.223171 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-c5b746b8-90e5-43f9-bda4-90b44aa9ece0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "disk": 20, "ram": 4096}} {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:14.248271 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-c5b746b8-90e5-43f9-bda4-90b44aa9ece0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076799 May 25 15:33:14.249040 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1282 bytes} [Tue May 25 15:33:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:33:14.260291 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-2e8e83dc-f0cd-448c-bfaa-76719bc334dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:14.299305 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-2e8e83dc-f0cd-448c-bfaa-76719bc334dc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042512 May 25 15:33:14.300093 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1335 bytes} [Tue May 25 15:33:14 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:33:16.419918 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-c5b746b8-90e5-43f9-bda4-90b44aa9ece0 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:16.420931 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-c5b746b8-90e5-43f9-bda4-90b44aa9ece0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 25 15:33:16.421329 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:33:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:33:16.481838 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-8ca6e750-94d8-48b7-9a56-d6eb3f754d13 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:16.506116 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-8ca6e750-94d8-48b7-9a56-d6eb3f754d13 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078416 May 25 15:33:16.506973 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1291 bytes} [Tue May 25 15:33:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:33:19.002033 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-c5b746b8-90e5-43f9-bda4-90b44aa9ece0 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:19.004019 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-c5b746b8-90e5-43f9-bda4-90b44aa9ece0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002746 May 25 15:33:19.004586 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:33:18 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:33:19.070920 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-2961e700-ed47-4c08-bbdb-65c8219c9019 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "vcpus": 1}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:19.097673 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-2961e700-ed47-4c08-bbdb-65c8219c9019 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.087117 May 25 15:33:19.098213 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1282 bytes} [Tue May 25 15:33:19 2021] POST /compute/v2.1/flavors => generated 402 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:33:19.109669 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-2e5fc0ca-f284-46ec-ba18-e381dbb76e91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:19.146076 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-2e5fc0ca-f284-46ec-ba18-e381dbb76e91 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040033 May 25 15:33:19.146657 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1332 bytes} [Tue May 25 15:33:19 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:33:21.490338 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-2961e700-ed47-4c08-bbdb-65c8219c9019 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:21.491355 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-2961e700-ed47-4c08-bbdb-65c8219c9019 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 25 15:33:21.491764 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:33:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:33:21.548337 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-6758a955-faf1-4ffa-bf1e-a54ac33f388b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:21.573305 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-6758a955-faf1-4ffa-bf1e-a54ac33f388b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075588 May 25 15:33:21.573851 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1282 bytes} [Tue May 25 15:33:21 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:33:21.587604 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-64946c52-976f-475d-8a86-12d4280c461f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:21.633617 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-64946c52-976f-475d-8a86-12d4280c461f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050975 May 25 15:33:21.634459 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1332 bytes} [Tue May 25 15:33:21 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:33:23.734801 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-6758a955-faf1-4ffa-bf1e-a54ac33f388b admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:23.736480 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-6758a955-faf1-4ffa-bf1e-a54ac33f388b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 May 25 15:33:23.737052 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:33:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:33:23.793374 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-47660988-0665-49ba-8fe6-b180a1dce33f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "id": "3", "disk": 40}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:23.819778 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-47660988-0665-49ba-8fe6-b180a1dce33f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077022 May 25 15:33:23.820619 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1282 bytes} [Tue May 25 15:33:23 2021] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:33:23.831808 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-4c045a8f-9441-4cb3-914e-c1652f11bcc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:23.867306 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-4c045a8f-9441-4cb3-914e-c1652f11bcc4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039172 May 25 15:33:23.867918 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1332 bytes} [Tue May 25 15:33:23 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:33:25.984266 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-47660988-0665-49ba-8fe6-b180a1dce33f admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:25.985788 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-47660988-0665-49ba-8fe6-b180a1dce33f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002188 May 25 15:33:25.986537 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:33:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:33:26.051421 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-8d911121-ce63-40bd-bedc-0c8aa4e26bf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:26.081752 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-8d911121-ce63-40bd-bedc-0c8aa4e26bf2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083605 May 25 15:33:26.084280 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1282 bytes} [Tue May 25 15:33:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:33:26.090910 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-1d3e65b4-0adf-45f5-8ac1-c5aa0faf282f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:26.129729 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-1d3e65b4-0adf-45f5-8ac1-c5aa0faf282f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042422 May 25 15:33:26.130239 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1332 bytes} [Tue May 25 15:33:26 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:33:28.302065 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-8d911121-ce63-40bd-bedc-0c8aa4e26bf2 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:33:28.303682 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-8d911121-ce63-40bd-bedc-0c8aa4e26bf2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 May 25 15:33:28.304281 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:33:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:33:28.370398 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-f62c289c-e01a-4ea9-9ebe-446f18408028 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:28.398586 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-f62c289c-e01a-4ea9-9ebe-446f18408028 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.087574 May 25 15:33:28.399337 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1282 bytes} [Tue May 25 15:33:28 2021] POST /compute/v2.1/flavors => generated 408 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:33:28.412088 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-714a34fa-771b-47d4-92f9-159db4f797fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:33:28.449216 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-714a34fa-771b-47d4-92f9-159db4f797fa admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041580 May 25 15:33:28.463896 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1332 bytes} [Tue May 25 15:33:28 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:34:07.062233 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-f62c289c-e01a-4ea9-9ebe-446f18408028 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:07.063826 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-f62c289c-e01a-4ea9-9ebe-446f18408028 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 25 15:34:07.064279 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 930 bytes} [Tue May 25 15:34:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:34:07.120070 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-4642d4dd-ea6a-480a-b7ac-5e4244a19666 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:07.143806 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-4642d4dd-ea6a-480a-b7ac-5e4244a19666 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073570 May 25 15:34:07.144376 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1291 bytes} [Tue May 25 15:34:07 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:34:08.522952 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-f62c289c-e01a-4ea9-9ebe-446f18408028 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:08.524018 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-f62c289c-e01a-4ea9-9ebe-446f18408028 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 25 15:34:08.524419 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1075 bytes} [Tue May 25 15:34:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:34:08.710335 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-21a57724-7815-401d-857f-46f6e79545bf admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:08.723115 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.wsgi [None req-21a57724-7815-401d-857f-46f6e79545bf admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 15:34:08.723698 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-21a57724-7815-401d-857f-46f6e79545bf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=97736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:34:08.724534 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-21a57724-7815-401d-857f-46f6e79545bf admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.063611 May 25 15:34:08.725051 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1191 bytes} [Tue May 25 15:34:08 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 15:34:08.734065 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-b4135782-ec02-4fb8-966e-51eb217febf7 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:08.754483 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-b4135782-ec02-4fb8-966e-51eb217febf7 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023927 May 25 15:34:08.755010 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1211 bytes} [Tue May 25 15:34:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:34:08.764486 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-980bd0d5-a6f0-4387-a2f8-ed69a7569b3c admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:08.784671 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-980bd0d5-a6f0-4387-a2f8-ed69a7569b3c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023646 May 25 15:34:08.785193 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1211 bytes} [Tue May 25 15:34:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:34:08.794189 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-dff2948c-5c9a-4257-9b15-62e74bffaf79 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:08.806196 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.wsgi [None req-dff2948c-5c9a-4257-9b15-62e74bffaf79 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 15:34:08.806777 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-dff2948c-5c9a-4257-9b15-62e74bffaf79 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=97737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:34:08.807581 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-dff2948c-5c9a-4257-9b15-62e74bffaf79 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.016864 May 25 15:34:08.808125 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1191 bytes} [Tue May 25 15:34:08 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 25 15:34:10.105860 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-980bd0d5-a6f0-4387-a2f8-ed69a7569b3c admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:10.106858 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-980bd0d5-a6f0-4387-a2f8-ed69a7569b3c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 25 15:34:10.107253 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1075 bytes} [Tue May 25 15:34:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:34:10.297374 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-dbbc6e71-58e9-4d1c-9005-dde8d5d5ab7d admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:10.309924 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.wsgi [None req-dbbc6e71-58e9-4d1c-9005-dde8d5d5ab7d admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 15:34:10.310490 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-dbbc6e71-58e9-4d1c-9005-dde8d5d5ab7d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=97737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:34:10.311275 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-dbbc6e71-58e9-4d1c-9005-dde8d5d5ab7d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.063950 May 25 15:34:10.311783 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1191 bytes} [Tue May 25 15:34:10 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 15:34:10.320803 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-f62983c6-b93a-43c1-a986-1ab43d0dc6bf admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:10.340110 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-f62983c6-b93a-43c1-a986-1ab43d0dc6bf admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022796 May 25 15:34:10.340621 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1211 bytes} [Tue May 25 15:34:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:34:10.350205 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-017b0ce5-6d39-417d-a71b-9ea1678c19de admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:10.372132 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-017b0ce5-6d39-417d-a71b-9ea1678c19de admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025226 May 25 15:34:10.372661 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1211 bytes} [Tue May 25 15:34:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:34:10.382005 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-5ef584a1-6737-4926-bc60-1995ef7f8dd8 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:10.396195 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.wsgi [None req-5ef584a1-6737-4926-bc60-1995ef7f8dd8 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 15:34:10.396770 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-5ef584a1-6737-4926-bc60-1995ef7f8dd8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=97736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:34:10.397554 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-5ef584a1-6737-4926-bc60-1995ef7f8dd8 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.019345 May 25 15:34:10.398055 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1191 bytes} [Tue May 25 15:34:10 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 25 15:34:11.696823 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-017b0ce5-6d39-417d-a71b-9ea1678c19de admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:11.697816 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-017b0ce5-6d39-417d-a71b-9ea1678c19de admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 25 15:34:11.698215 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1075 bytes} [Tue May 25 15:34:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:34:11.884337 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-5f58d77d-69e3-49f7-ad01-64b6f838ba8a admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:11.896363 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.wsgi [None req-5f58d77d-69e3-49f7-ad01-64b6f838ba8a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 15:34:11.896938 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-5f58d77d-69e3-49f7-ad01-64b6f838ba8a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=97736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:34:11.897731 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-5f58d77d-69e3-49f7-ad01-64b6f838ba8a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.064249 May 25 15:34:11.898232 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1194 bytes} [Tue May 25 15:34:11 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 15:34:11.908196 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-8bda6556-820e-4661-8589-20577b2533e0 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:11.929912 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-8bda6556-820e-4661-8589-20577b2533e0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025976 May 25 15:34:11.930438 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1211 bytes} [Tue May 25 15:34:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:34:11.939846 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:11.959198 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022859 May 25 15:34:11.959718 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1211 bytes} [Tue May 25 15:34:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:34:11.968433 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-deb49fff-e5b1-4b5c-93b8-f373645dcf23 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:11.980523 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.wsgi [None req-deb49fff-e5b1-4b5c-93b8-f373645dcf23 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 15:34:11.981085 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-deb49fff-e5b1-4b5c-93b8-f373645dcf23 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=97737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:34:11.981857 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-deb49fff-e5b1-4b5c-93b8-f373645dcf23 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.016859 May 25 15:34:11.982346 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1194 bytes} [Tue May 25 15:34:11 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 15:34:13.295442 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:13.296476 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 25 15:34:13.296870 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1075 bytes} [Tue May 25 15:34:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:34:13.486048 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-b2f3f09f-89b3-4636-b54b-41c82fef3f64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:34:13.509379 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-b2f3f09f-89b3-4636-b54b-41c82fef3f64 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.074913 May 25 15:34:13.509849 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1236 bytes} [Tue May 25 15:34:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:34:14.836260 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:14.837252 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 25 15:34:14.837650 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1075 bytes} [Tue May 25 15:34:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:34:15.023722 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-28750e5f-9b2e-473b-ba24-94e0374ea7fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:34:15.047304 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-28750e5f-9b2e-473b-ba24-94e0374ea7fb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.073161 May 25 15:34:15.048424 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1236 bytes} [Tue May 25 15:34:14 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:34:16.380575 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:16.381568 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 25 15:34:16.381947 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1075 bytes} [Tue May 25 15:34:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:34:16.570807 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-53ebf125-079e-434b-8859-415d8dec201b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:34:16.596921 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-53ebf125-079e-434b-8859-415d8dec201b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.077534 May 25 15:34:16.597407 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1236 bytes} [Tue May 25 15:34:16 2021] POST /compute/v2.1/flavors => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:34:17.897244 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:17.898237 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 25 15:34:17.898630 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1075 bytes} [Tue May 25 15:34:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:34:18.087875 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-e9136abf-0adc-49ff-8fc6-5afeb067032a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:34:18.111011 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-e9136abf-0adc-49ff-8fc6-5afeb067032a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.073873 May 25 15:34:18.111563 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1236 bytes} [Tue May 25 15:34:18 2021] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:34:19.427410 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:19.428429 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 25 15:34:19.428824 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1075 bytes} [Tue May 25 15:34:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:34:19.617721 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-832ce591-fb53-49bb-ad1b-88cd33150cbe admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:34:19.643216 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-832ce591-fb53-49bb-ad1b-88cd33150cbe admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.075451 May 25 15:34:19.643687 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1203 bytes} [Tue May 25 15:34:19 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:35:04.181269 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:35:04.182339 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-1c63356c-ce06-4d46-9a4f-6756ad549526 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 25 15:35:04.182719 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 31/63] 10.222.0.36 () {56 vars in 1075 bytes} [Tue May 25 15:35:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:35:04.372943 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-4bdb19d0-c3de-4ff3-9ab8-e4682feffde1 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:35:04.399092 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-4bdb19d0-c3de-4ff3-9ab8-e4682feffde1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.076611 May 25 15:35:04.399558 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1203 bytes} [Tue May 25 15:35:04 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:36:26.753847 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-3293d576-ed7e-4edc-b75d-b87ce7f65094 tempest-verify_tempest_config-2045977239 tempest-verify_tempest_config-2045977239-project] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:36:26.756055 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-3293d576-ed7e-4edc-b75d-b87ce7f65094 tempest-verify_tempest_config-2045977239 tempest-verify_tempest_config-2045977239-project] 10.222.0.36 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.118477 May 25 15:36:26.756590 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 32/65] 10.222.0.36 () {58 vars in 1134 bytes} [Tue May 25 15:36:26 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:38:06.064412 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-4bdb19d0-c3de-4ff3-9ab8-e4682feffde1 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:38:06.065456 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-4bdb19d0-c3de-4ff3-9ab8-e4682feffde1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 May 25 15:38:06.065853 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 34/66] 10.222.0.36 () {56 vars in 1075 bytes} [Tue May 25 15:38:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:38:06.328874 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-5d7b397a-7bcf-4545-993d-059a203c4884 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:38:06.330194 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:38:06.330194 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: warnings.warn(msg) May 25 15:38:06.332037 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_concurrency.lockutils [None req-5d7b397a-7bcf-4545-993d-059a203c4884 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:38:06.332489 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_concurrency.lockutils [None req-5d7b397a-7bcf-4545-993d-059a203c4884 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:38:06.333323 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_concurrency.lockutils [None req-5d7b397a-7bcf-4545-993d-059a203c4884 admin admin] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:38:06.333756 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_concurrency.lockutils [None req-5d7b397a-7bcf-4545-993d-059a203c4884 admin admin] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:38:06.372252 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-5d7b397a-7bcf-4545-993d-059a203c4884 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.165924 May 25 15:38:06.375898 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1194 bytes} [Tue May 25 15:38:06 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:38:07.725010 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: DEBUG nova.api.openstack.wsgi [None req-4bdb19d0-c3de-4ff3-9ab8-e4682feffde1 admin admin] Calling method '>' {{(pid=97737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:38:07.726038 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: INFO nova.api.openstack.requestlog [None req-4bdb19d0-c3de-4ff3-9ab8-e4682feffde1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 25 15:38:07.726424 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: [pid: 97737|app: 0|req: 35/68] 10.222.0.36 () {56 vars in 1075 bytes} [Tue May 25 15:38:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:38:07.933969 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG nova.api.openstack.wsgi [None req-b3d2828a-cdf8-4796-9564-167525077c56 admin admin] Calling method '>' {{(pid=97736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:38:07.935055 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:38:07.935055 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: warnings.warn(msg) May 25 15:38:07.936813 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_concurrency.lockutils [None req-b3d2828a-cdf8-4796-9564-167525077c56 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:38:07.937258 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_concurrency.lockutils [None req-b3d2828a-cdf8-4796-9564-167525077c56 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:38:07.938062 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_concurrency.lockutils [None req-b3d2828a-cdf8-4796-9564-167525077c56 admin admin] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:38:07.938581 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: DEBUG oslo_concurrency.lockutils [None req-b3d2828a-cdf8-4796-9564-167525077c56 admin admin] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:38:07.966764 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: INFO nova.api.openstack.requestlog [None req-b3d2828a-cdf8-4796-9564-167525077c56 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.087394 May 25 15:38:07.967325 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: [pid: 97736|app: 0|req: 34/69] 10.222.0.36 () {60 vars in 1194 bytes} [Tue May 25 15:38:07 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:39:09.311355 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: Tue May 25 15:39:09 2021 - graceful shutdown triggered... May 25 15:39:09.311874 dv-cinder-791239-3-iscsi devstack@n-api.service[97737]: Gracefully killing worker 2 (pid: 97737)... May 25 15:39:09.311607 dv-cinder-791239-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 25 15:39:09.312965 dv-cinder-791239-3-iscsi devstack@n-api.service[97736]: Gracefully killing worker 1 (pid: 97736)... May 25 15:39:10.312489 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: worker 1 buried after 1 seconds May 25 15:39:10.312489 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: worker 2 buried after 1 seconds May 25 15:39:10.312489 dv-cinder-791239-3-iscsi devstack@n-api.service[97735]: goodbye to uWSGI. May 25 15:39:10.314583 dv-cinder-791239-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 25 15:39:10.315148 dv-cinder-791239-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 25 15:39:10.318125 dv-cinder-791239-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 15:39:10.327188 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 25 15:39:10 2021] *** May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: nodename: dv-cinder-791239-3-iscsi May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: machine: x86_64 May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: clock source: unix May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: pcre jit disabled May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: detected number of CPU cores: 4 May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: current working directory: / May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: detected binary path: /usr/bin/uwsgi-core May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: your processes number limit is 47680 May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: your memory page size is 4096 bytes May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: detected max file descriptor number: 2048 May 25 15:39:10.329259 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: lock engine: pthread robust mutexes May 25 15:39:10.330756 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: thunder lock: enabled May 25 15:39:10.330756 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 15:39:10.330756 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 25 15:39:10.371341 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: Python main interpreter initialized at 0x55c18d7309c0 May 25 15:39:10.371341 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: python threads support enabled May 25 15:39:10.371341 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: your server socket listen backlog is limited to 100 connections May 25 15:39:10.371341 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: your mercy for graceful operations on workers is 90 seconds May 25 15:39:10.371793 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: mapped 403077 bytes (393 KB) for 2 cores May 25 15:39:10.371793 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: *** Operational MODE: preforking *** May 25 15:39:10.372151 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: *** uWSGI is running in multiple interpreter mode *** May 25 15:39:10.372151 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: spawned uWSGI master process (pid: 112557) May 25 15:39:10.372363 dv-cinder-791239-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 15:39:10.373219 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: spawned uWSGI worker 1 (pid: 112576, cores: 1) May 25 15:39:10.373340 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: spawned uWSGI worker 2 (pid: 112577, cores: 1) May 25 15:39:10.373485 dv-cinder-791239-3-iscsi devstack@n-api.service[112557]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 15:39:12.133465 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:39:12.133465 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: from cryptography.utils import int_from_bytes May 25 15:39:12.134117 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:39:12.134117 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: from cryptography.utils import int_from_bytes May 25 15:39:12.142974 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:39:12.142974 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: from cryptography.utils import int_from_bytes May 25 15:39:12.143493 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:39:12.143493 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: from cryptography.utils import int_from_bytes May 25 15:39:14.572660 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:39:14.573099 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:39:14.573431 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:39:14.573810 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:39:14.574072 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:39:14.574471 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.574812 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.575146 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.575475 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.575820 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.576170 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.576507 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.576841 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.577181 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.577455 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.577782 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.578121 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-791239-3-iscsi {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.578455 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.580340 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.580340 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.580340 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.580340 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.580659 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.580941 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.581453 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.582779 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.582779 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.582979 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.583573 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.583573 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.583971 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.584311 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.584633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.584971 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.585294 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.585717 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-791239-3-iscsi {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.586051 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.586378 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.586707 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.587144 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.587469 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.587791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.588169 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.588506 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.588820 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.589166 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.589499 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.589833 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.590166 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.590481 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.590804 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.591129 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.591461 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.591796 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.592125 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.592388 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.592708 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.593041 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.593373 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.593708 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.593974 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.594237 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.594569 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.594903 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.595253 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.595573 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.595903 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.596229 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.596549 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.596867 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.597184 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.597503 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.597833 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.598162 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.598502 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.598820 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.599155 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.599306 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:39:14.599717 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.599821 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:39:14.599938 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.600086 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:39:14.600194 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.600468 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:39:14.600573 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.600741 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:39:14.600845 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.601124 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.601274 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.601449 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.601562 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.601787 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.601904 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.602105 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.602204 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.602423 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.602516 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.602742 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.602842 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.603073 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.603180 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.603407 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.603510 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.603721 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.603818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.604013 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.604115 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.604328 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.604430 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.604645 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.604744 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-791239-3-iscsi {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.604974 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.605065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.605292 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.605397 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.605610 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.605708 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.605927 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.606022 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.606241 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.606365 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.606562 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.606689 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.606879 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.607979 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.607979 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.608154 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.608250 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.608323 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.608391 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.608460 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.608541 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.608618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.608704 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.608786 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.608857 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.609125 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.609221 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.609382 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.609486 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.609661 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.609758 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.609980 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.610088 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.610295 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.610393 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.611133 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.611254 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.611457 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.611564 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-791239-3-iscsi {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.611791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.611932 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.612136 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.612247 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.612457 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.612565 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.612792 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.612956 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.613113 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.613263 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.613425 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.613594 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.613760 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.613914 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.614078 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.614257 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.614580 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.614691 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.614927 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.615040 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.615243 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.615375 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.615563 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.615684 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.615915 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.616014 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.616242 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.616339 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.616549 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.616659 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.616866 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.617007 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.617185 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.617291 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.617497 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.617641 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.617812 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.618109 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.618213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.618378 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.618488 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.618705 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.618798 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.619041 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.619130 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.619377 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.619481 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.619704 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.619798 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.620013 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.620171 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.620283 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.620440 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.620621 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.620721 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.620959 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.621050 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.621284 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.621376 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.621607 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.621705 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.621928 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.622020 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.622251 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.622342 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.622573 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.622674 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.622895 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.622998 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.623217 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.623308 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.623537 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.623667 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.623962 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.624069 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.624221 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.624375 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.624560 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.624661 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.624883 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.624991 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.625213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.625305 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.625547 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.625651 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.625885 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.625976 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.626231 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.626806 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.627115 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.627214 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.627465 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.627614 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.627774 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.627886 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.628133 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.628241 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.628469 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.628568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.628793 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.628885 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.629114 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.629225 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.629436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.629529 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.629771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.629862 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.630107 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.630250 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.630430 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.630529 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.630694 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.630785 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.631008 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.631115 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.631328 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.631426 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.631660 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.631752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.632008 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.632124 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.632329 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.632429 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.632913 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.633008 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.633229 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.633322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.633566 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.633699 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.633886 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.634016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.634188 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.634280 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.634510 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.634626 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.634829 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.634953 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.635149 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.635247 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.635471 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.635568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.635790 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.635912 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.636145 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.636242 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.636462 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.636560 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.636792 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.636931 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.637107 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.637202 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.637430 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.637528 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.637750 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.637865 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.638074 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.638185 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.638386 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.638490 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.638709 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.638812 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.639032 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.639127 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.639351 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.639449 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.639670 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.639778 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.640018 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.640116 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.640350 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.640459 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.640659 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.640763 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.640981 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.641078 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.641304 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.641463 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.641630 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.641782 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.641982 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.642145 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.642394 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.642559 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.642659 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.642788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.642946 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.643110 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.643275 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.643430 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.643602 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.643750 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.643979 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.644221 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.644439 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.644615 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.644865 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.645353 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.645453 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.645538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.645636 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.645728 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.645823 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.646010 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.646106 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.646189 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.646287 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.646416 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.646507 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.646740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.646830 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.647061 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.647153 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.647394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:39:14.647487 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.647729 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.647818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.648080 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.648184 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.648402 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.648502 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.648724 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.648817 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.649045 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.649145 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.649386 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.649480 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.649718 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.649809 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.650042 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.650134 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.650363 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.650508 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.650686 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.650791 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.651034 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.651133 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.651353 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.651445 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.651681 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.651780 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.652044 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.652141 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.652381 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.652479 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.652716 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.652821 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.653045 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.653137 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.653366 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.653471 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.653687 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.653780 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.654013 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.654107 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.654349 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.654442 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.654670 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.654761 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.655002 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.655117 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.655322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.655466 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.655649 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.655749 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.656014 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.656111 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.656363 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.656466 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.656688 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.656787 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.657018 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.657115 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.657354 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.657459 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.657704 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.657796 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.658032 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.658121 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.658355 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.658454 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.658678 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.658777 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.658999 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.659090 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.659324 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.659416 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.659652 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.659750 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.660006 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.660113 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.660350 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.660484 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.660655 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.660774 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.660980 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.661082 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.661302 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.661400 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.661622 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.661715 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.661943 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.662047 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.662266 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.662365 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.662602 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.662737 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.662927 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.663033 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.663264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.663364 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.663592 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.663690 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.663949 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.664063 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.664249 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.664343 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.664574 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.664672 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.664896 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.665014 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.665257 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.665393 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.665531 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.665634 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.665848 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.665965 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.666189 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.666281 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.666512 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.666602 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.666830 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.666929 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.667158 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.667249 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.667483 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.667573 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.667804 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.667922 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.668159 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.668249 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.668480 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.668576 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.668803 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.668903 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.669134 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.669253 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.669468 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.669583 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.669793 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.669925 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.670753 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.670932 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.671098 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.671324 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.671501 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.671654 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.671804 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.671987 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.672139 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.672302 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.672453 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.672614 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.672779 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.672938 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.673588 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.673762 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.673922 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.674093 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.674253 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.674404 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.674561 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.674736 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.674736 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.675025 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.675176 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.675332 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.675493 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.675646 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.675813 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.675999 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.676165 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.676316 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.676476 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.676627 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.676788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.676948 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.677108 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.677242 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.677368 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.677506 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.677603 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.677687 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.677770 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.677860 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.677953 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.678037 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.678126 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.678206 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.678308 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.678461 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.678641 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.678812 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.678985 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.679149 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.679322 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.679423 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.679655 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.679747 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.680006 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.680105 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.680333 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.680437 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.680648 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.680752 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.680968 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.681068 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.681299 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.681404 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.681621 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.681711 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.681943 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.682033 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.682259 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.682429 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.682583 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.682734 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.682908 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.683002 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.683226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.683319 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.683546 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.683648 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.683877 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.683972 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.684234 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.684326 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.684552 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.684641 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.684878 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.684968 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.685203 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.685340 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.685528 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.685627 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.685865 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.685957 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.686188 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.686269 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.686515 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.686596 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.686832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.686968 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.687237 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.687378 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.687500 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.687593 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.687781 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.687905 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.688127 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.688221 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.688453 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.688557 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.688831 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.689427 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.689663 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.689763 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.689989 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.690089 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.690316 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.690417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.690643 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.690734 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.690962 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.691061 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.691285 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.691387 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.691603 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.691736 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.691950 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.692095 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.692273 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.692421 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.692599 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.692742 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.692924 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.693064 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.693243 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.693426 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.693581 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.693754 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.693908 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.694078 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.694226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.694412 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.694554 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.694751 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.694891 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.695176 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.695375 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.695528 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.695715 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.695823 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.696079 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.696171 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.696411 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.696501 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.696777 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.696920 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.697097 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.697265 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.697411 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.697597 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.697739 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.697929 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.698031 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.698257 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.698348 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.698584 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.698692 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.698913 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.699005 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.699237 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.699334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.699553 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.699657 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.699909 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.700018 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.700227 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.700319 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.700542 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.700716 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.700863 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.700964 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.701181 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.701272 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.701538 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.701768 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.701869 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.702117 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.702208 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.702450 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.702551 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.702789 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.702888 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.703123 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.703225 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.703459 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.703565 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.703780 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.703885 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.704139 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.704239 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.704484 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.704595 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.704818 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.704917 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.705143 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.705234 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.705467 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.705559 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.705784 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.705873 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.706104 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.706205 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.706422 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.706520 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.706745 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.706848 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.707067 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.707205 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.707393 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.707493 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.707716 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.707806 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.708076 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.708171 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.708398 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.708492 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.708716 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.708807 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.709037 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.709137 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.709359 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.709450 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.709678 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.709766 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.709998 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.710091 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.710325 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.710413 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.710650 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.710730 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.710967 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.711056 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.711289 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.711376 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.711606 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.711693 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.712503 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.712687 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.712842 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.713001 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.713160 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.713308 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.713440 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.713560 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.713672 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.713782 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.713782 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.713986 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.714105 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.714229 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.714349 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.714471 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.714566 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.714658 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.714883 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.715029 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.715201 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.715292 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.715527 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.715651 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.715894 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.716119 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.716451 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.716774 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.717103 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.717248 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.717431 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.717551 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.717761 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.717863 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.718088 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.718199 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.718411 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.718514 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.718804 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.718905 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.719139 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.719230 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.719474 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.719566 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.719801 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.719914 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.720182 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.720274 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.720503 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.720606 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.720832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.720933 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.721163 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.721253 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.721480 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.721569 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.721801 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.721895 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.722120 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.722211 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.722450 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.722548 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.722767 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.722866 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.723092 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.723181 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.723419 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.723519 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.723750 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.723843 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.724121 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.724214 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.724460 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.724584 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.724787 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.724941 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.725116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.725238 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.725440 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.725575 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.725764 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.725913 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.726093 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.726253 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.726419 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.726576 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.726740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.726904 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.727063 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.727229 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.727385 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.727569 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.727698 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.727950 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.728098 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.728272 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.728377 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.728607 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.728700 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.728927 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.729020 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.729266 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.729369 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.729602 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.729700 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.729931 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.730029 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.730273 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.730450 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.730653 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.730745 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.730978 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.731109 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.731313 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.731409 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.731654 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.731753 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.732018 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.732126 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.732342 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.732441 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.732664 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.732763 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.732983 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.733073 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.733302 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.733394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.733625 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.733724 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.733954 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.734053 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.734273 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.734373 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.734592 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.734729 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.734915 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.735021 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.735238 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.735339 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.735557 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.736207 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.736408 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.736540 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.736747 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.736877 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.737093 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.737419 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.737749 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.737927 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.738083 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.738241 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.738393 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.738558 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.738709 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.738878 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.739038 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.739197 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.739348 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.739498 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.739657 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.739818 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.740038 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.740193 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.740351 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.740502 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.740674 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.740834 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.740986 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.741089 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.741211 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.741410 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.741538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.741734 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.741861 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.742075 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.742205 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.742420 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.742521 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.742768 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.742869 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.743097 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.743197 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.743448 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.743541 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.743771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.743889 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.744122 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.744258 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.744568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.744670 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.744899 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.744995 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.745227 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.745328 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.745548 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.745644 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.745871 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.745982 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.746196 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.746289 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.746519 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.746616 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.746839 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.746936 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.747159 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.747266 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.747467 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.747599 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.747792 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.747956 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.748156 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.748290 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.748499 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.748617 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.748820 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.749117 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.749215 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.749452 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.749557 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.749770 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.749866 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.750090 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.750188 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.750407 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.750504 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.750731 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.750852 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.751087 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.752018 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.752201 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.752385 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.752569 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.752667 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.752905 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.753016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.753256 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.753360 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.753650 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.753746 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.753984 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.754095 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.754318 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.754424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.754633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.754769 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.754970 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.755300 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.755437 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.755634 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.755965 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.756065 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.756317 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.756422 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.756650 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.756754 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.756983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.757081 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.757311 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.757416 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.757915 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.758150 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.758247 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.758498 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.758605 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.758833 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.759051 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.759144 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.759224 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.759479 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.759649 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.759883 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.760031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.760214 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.760458 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.760618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.761346 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.761525 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.761678 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.761828 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.762003 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.762155 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.762304 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.762454 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.762603 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.762760 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.762918 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.763076 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.763233 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.763488 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.763646 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.763807 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.764010 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.764170 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.764321 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.764470 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.764625 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.764786 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.764936 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.765175 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.765345 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.765632 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.765843 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.766017 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.766183 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.766334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.766482 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.766639 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.766802 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.766981 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.767137 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.767287 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.767442 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.767591 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.767752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.767933 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.768119 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.768290 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.768702 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.768871 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.769032 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.769183 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.769332 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.769484 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.769642 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.769802 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.769962 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.770241 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.770414 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.770577 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.770734 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.770912 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.771619 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.771785 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.772005 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.772160 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.772309 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.772468 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.772618 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.772766 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.772766 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.773064 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.773239 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.773396 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.773546 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.773693 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.773841 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.773990 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.774147 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.774304 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.774459 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.774616 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.774764 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.774911 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.775068 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.775312 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.775476 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.775628 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.775784 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.775954 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.776122 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.776282 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.776434 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.776582 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.776737 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.776896 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.777045 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.777204 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.777362 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.777512 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.777660 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.777817 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.777973 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.778130 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.778286 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.778445 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.778613 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.778883 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.779041 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.779190 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.779351 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.779500 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.779662 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.779820 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.780003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.780003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.780288 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.780437 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.780610 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.780770 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.780918 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.781065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.781565 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.781565 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.782072 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.782072 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.782376 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.782562 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.782723 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.782880 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.783039 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.783196 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.783346 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.783520 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.783779 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.784008 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.784184 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.784184 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.784480 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.784629 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.784778 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.784936 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.785094 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.785244 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.785486 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.785649 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.785925 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.786091 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.786261 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.786413 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.786562 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.786711 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.786860 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.787022 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.787172 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.787320 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.787475 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.787633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.787782 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.788037 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.788199 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.788368 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.788368 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.788672 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.788855 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.789079 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.789235 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.789392 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.789543 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.789697 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.789856 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.790007 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.790163 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.790312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.790471 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.790629 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.790788 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.790945 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.790945 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.791238 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.791728 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.792090 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.792251 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.792409 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.792566 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.792723 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.792884 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.793043 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.793202 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.793360 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.793360 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.793661 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.793811 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.793968 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.793968 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.794422 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.794422 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.794735 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.794735 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.795189 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.795382 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.795632 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.795790 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.795985 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.796147 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.796300 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.796458 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.796616 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.796773 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.796924 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.797081 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.797251 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.797411 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.797568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.797723 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.797886 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.798037 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.798701 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.798853 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.799010 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.799247 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.799414 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.799566 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.799735 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.799912 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.800079 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.800230 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.800392 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.800392 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.800686 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.800837 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.800986 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.801145 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.801302 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.802035 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.802570 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.802724 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.802875 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.803039 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.803197 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.803363 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.803520 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.803678 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.803827 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.804018 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.804171 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.804328 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.804478 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.804646 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.804796 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.804957 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.805107 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.805255 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.805412 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.805563 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.805811 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.806046 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.806209 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.806359 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.806515 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.806672 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.813590 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.815108 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.815405 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.815699 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.815994 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.816179 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.816338 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.816586 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.816743 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.816892 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.817050 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.817213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.817378 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.817567 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.817729 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.817880 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.817880 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.818245 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.818404 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.818554 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.825277 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.825477 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.825654 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.825820 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.826010 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.826302 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.826464 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.826651 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.826806 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.826957 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.827106 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.827255 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.827413 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.827577 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.827737 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.827908 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.828076 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.828248 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.828432 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.828603 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.828760 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.828910 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.829059 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.829208 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.829384 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.829548 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.829708 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.829860 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.830018 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.830168 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.830367 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.830578 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.830732 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.830883 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.831033 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.831182 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.831367 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.831754 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.831933 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.832105 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.832288 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.833176 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.833356 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.833510 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.833660 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.833810 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.833961 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.834118 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.834284 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.834471 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.834634 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.834793 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.834944 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.834944 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.835497 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.835672 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.835824 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.836022 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.836184 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.836450 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.836608 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.836758 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.836907 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.837064 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.837265 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.837426 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.837584 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.837735 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.837897 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.838047 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.838047 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.838348 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.838534 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.838700 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.838854 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.839011 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.839161 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.839394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.839546 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.839703 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.839853 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.840075 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.840237 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.840390 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.840546 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.840704 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.840862 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.841019 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.841214 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.841378 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.841529 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.841529 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.841823 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.841984 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.842147 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.842345 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.842790 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.843217 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.843390 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.843558 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.843717 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.843908 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.844068 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.844218 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.844368 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.844535 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.844699 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.844898 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.845089 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.845478 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.845641 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.845808 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.845968 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.846128 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.846278 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.846278 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.846692 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.846861 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.847035 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.847188 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.847345 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.847533 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.847767 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.847942 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.848099 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.848248 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.848628 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:39:14.848803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.848803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.848803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.848803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.848803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.848803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.848803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.848803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.850031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.850031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.850031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.850031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.850031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.850031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.850031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.850031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.851261 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.851261 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.851261 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.851261 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.851261 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.851261 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.851261 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.851261 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.852512 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.852512 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.852512 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.852512 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.852512 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.852512 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.852512 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.852512 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.854312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.854312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.854312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.854312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.854312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.854312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.854312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.854312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.855730 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.855730 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.855730 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.855730 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.855730 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.855730 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.855730 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.855730 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.857132 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.857132 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.857132 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.857132 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.857132 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.857132 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.857132 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.857132 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.858307 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.858307 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.858307 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.858307 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.858307 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.858307 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.858307 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.858307 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.859518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.859518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.859518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.859518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.859518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.859518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.859518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.859518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.861298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.861298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.861298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.861298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.861298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.861298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.861298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.861298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.862550 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.862550 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.862550 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.862550 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.862550 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.862550 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.862550 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.862550 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:39:14.864771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:39:14.864933 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_db.sqlalchemy.engines [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:39:14.893340 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_db.sqlalchemy.engines [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:39:15.207828 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.context [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d361204-4d46-4b6e-978b-1951a5dab06b(cell1) {{(pid=112576) load_cells /opt/stack/nova/nova/context.py:464}} May 25 15:39:15.212112 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:15.213792 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:15.214600 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:15.216624 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:15.240593 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.context [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d361204-4d46-4b6e-978b-1951a5dab06b(cell1) {{(pid=112577) load_cells /opt/stack/nova/nova/context.py:464}} May 25 15:39:15.240884 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_db.sqlalchemy.engines [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:39:15.241727 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_db.sqlalchemy.engines [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:39:15.244991 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:15.246700 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:15.247521 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:15.249562 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:15.276701 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_db.sqlalchemy.engines [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:39:15.277502 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_db.sqlalchemy.engines [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:39:15.278349 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_db.sqlalchemy.engines [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:39:15.306779 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_db.sqlalchemy.engines [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:39:15.607306 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: WARNING keystonemiddleware.auth_token [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:39:15.614245 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: WARNING keystonemiddleware.auth_token [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:39:15.631371 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: WARNING keystonemiddleware.auth_token [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:39:15.638366 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: WARNING keystonemiddleware.auth_token [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:39:15.849184 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: WARNING keystonemiddleware.auth_token [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:39:15.854568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: WARNING keystonemiddleware.auth_token [None req-c4ccc2ee-c182-48fe-9454-69baa9616d12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:39:15.859791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c18d7309c0 pid: 112576 (default app) May 25 15:39:15.874217 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: WARNING keystonemiddleware.auth_token [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:39:15.880250 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: WARNING keystonemiddleware.auth_token [None req-92f840a8-67f6-42ff-b58c-ef05d51c0cb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:39:15.885732 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c18d7309c0 pid: 112577 (default app) May 25 15:39:47.726075 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-52b28af7-2b1b-4887-aee4-f159329de16c tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Action: 'create', calling method: .version_select at 0x7f0886dbeaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1002453007"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:39:49.330419 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-bb713747-e25e-4baf-9044-adb5578705a1 tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] Action: 'create', calling method: .version_select at 0x7f0886dbfca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-506819030", "metadata": {"Type": "work"}}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:39:49.567258 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-52b28af7-2b1b-4887-aee4-f159329de16c tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.051569 May 25 15:39:49.572959 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1155 bytes} [Tue May 25 15:39:46 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3060 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 25 15:39:49.584425 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f06eb965-c4f3-4650-a4d7-23f9e5d619b4 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f08863a2430>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:49.728745 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f06eb965-c4f3-4650-a4d7-23f9e5d619b4 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b" status: 200 len: 345 microversion: 2.1 time: 0.152055 May 25 15:39:49.729345 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 2/2] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:39:49 2021] GET /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b => generated 345 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:39:50.495171 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9892a282-99a0-434a-907b-8fc1640d4da9 tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] Calling method '.version_select at 0x7f08863a2ca0>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:50.674871 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-bb713747-e25e-4baf-9044-adb5578705a1 tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.762208 May 25 15:39:50.682831 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1156 bytes} [Tue May 25 15:39:47 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2767 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 25 15:39:50.689428 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1b1714b6-d23b-4f08-8903-64b75b60ecdc tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] Calling method '.version_select at 0x7f08863a0430>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:50.725990 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9892a282-99a0-434a-907b-8fc1640d4da9 tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/7940962d-e0dd-4dec-b8f5-97be9946df38" status: 200 len: 351 microversion: 2.1 time: 0.235720 May 25 15:39:50.733891 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 3/4] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:39:50 2021] GET /compute/v2.1/os-volumes/7940962d-e0dd-4dec-b8f5-97be9946df38 => generated 351 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:39:50.742755 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3cee2efb-1f2b-47c9-846e-6417f4ecea42 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f08863a2dc0>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:50.905718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1b1714b6-d23b-4f08-8903-64b75b60ecdc tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d" status: 200 len: 352 microversion: 2.1 time: 0.220927 May 25 15:39:50.906869 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 2/5] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:39:50 2021] GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d => generated 352 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:39:51.087774 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3cee2efb-1f2b-47c9-846e-6417f4ecea42 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b" status: 200 len: 346 microversion: 2.1 time: 0.350377 May 25 15:39:51.095717 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 4/6] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:39:50 2021] GET /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b => generated 346 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:51.101711 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-afdb94b0-9114-454f-a04f-69d7aa63c13e tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Action: 'create', calling method: .version_select at 0x7f08863a0d30>, body: {"snapshot": {"volume_id": "e8aa5284-521f-4962-a872-6ab90e322a1b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1746146205"}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:39:51.517555 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-afdb94b0-9114-454f-a04f-69d7aa63c13e tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.420568 May 25 15:39:51.518141 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 3/7] 10.222.0.36 () {60 vars in 1162 bytes} [Tue May 25 15:39:51 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:51.527621 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-002c2196-b072-4242-b720-c2ea9e0d889d tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f08863a24c0>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:51.607386 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-002c2196-b072-4242-b720-c2ea9e0d889d tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb" status: 200 len: 287 microversion: 2.1 time: 0.083123 May 25 15:39:51.608243 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1251 bytes} [Tue May 25 15:39:51 2021] GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:51.618710 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-73353b1f-7fcd-434c-844b-32400ed9257f tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f08863a0af0>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:51.705076 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-73353b1f-7fcd-434c-844b-32400ed9257f tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.090469 May 25 15:39:51.705945 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 4/9] 10.222.0.36 () {58 vars in 1140 bytes} [Tue May 25 15:39:51 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:51.717046 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bc9aaeb0-ecaa-4af4-bdad-a02bc5c6b50a tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f08863be790>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:51.803683 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bc9aaeb0-ecaa-4af4-bdad-a02bc5c6b50a tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb" status: 200 len: 287 microversion: 2.1 time: 0.090831 May 25 15:39:51.804610 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 6/10] 10.222.0.36 () {58 vars in 1251 bytes} [Tue May 25 15:39:51 2021] GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:39:51.921405 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-58194f8b-3127-4b41-9d77-f8ea815d9809 tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] Calling method '.version_select at 0x7f08863be8b0>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:52.062926 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-58194f8b-3127-4b41-9d77-f8ea815d9809 tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d" status: 200 len: 353 microversion: 2.1 time: 0.148195 May 25 15:39:52.064661 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 5/11] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:39:51 2021] GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d => generated 353 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:52.075745 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0e968e4c-f342-48b3-bb06-51afd546e6e8 tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] Calling method '.version_select at 0x7f08863bedc0>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:52.280122 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0e968e4c-f342-48b3-bb06-51afd546e6e8 tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d" status: 200 len: 353 microversion: 2.1 time: 0.208565 May 25 15:39:52.280878 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 7/12] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:39:52 2021] GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d => generated 353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:39:52.298053 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-298e0952-1160-49e8-b718-ac63542ba9cd tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] Calling method '.version_select at 0x7f0886340160>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:52.428560 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-298e0952-1160-49e8-b718-ac63542ba9cd tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d" status: 202 len: 0 microversion: 2.1 time: 0.134650 May 25 15:39:52.429369 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 6/13] 10.222.0.36 () {58 vars in 1248 bytes} [Tue May 25 15:39:52 2021] DELETE /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:39:52.438560 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-23b76b7f-8225-40b1-bcf3-101e7a6b94b8 tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] Calling method '.version_select at 0x7f08863be550>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:52.501509 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-31eab2eb-8702-4c7e-bb51-49aa4b4cf420 tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] Calling method '.version_select at 0x7f08863a08b0>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:52.564213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-23b76b7f-8225-40b1-bcf3-101e7a6b94b8 tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d" status: 200 len: 352 microversion: 2.1 time: 0.130627 May 25 15:39:52.565567 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 8/14] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:39:52 2021] GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:52.627114 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-31eab2eb-8702-4c7e-bb51-49aa4b4cf420 tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/548c2758-678f-4a42-8f49-63f6448d3382" status: 200 len: 351 microversion: 2.1 time: 0.129237 May 25 15:39:52.629302 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 7/15] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:39:52 2021] GET /compute/v2.1/os-volumes/548c2758-678f-4a42-8f49-63f6448d3382 => generated 351 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:52.815654 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c433df45-9af9-4800-8dd9-fd94ed4bf181 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f08863a28b0>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:52.908956 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c433df45-9af9-4800-8dd9-fd94ed4bf181 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb" status: 200 len: 287 microversion: 2.1 time: 0.097028 May 25 15:39:52.910137 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 9/16] 10.222.0.36 () {58 vars in 1251 bytes} [Tue May 25 15:39:52 2021] GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:53.578866 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c8b8eb6b-9755-4a22-9f12-eba905d9011a tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] Calling method '.version_select at 0x7f08863a0f70>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:53.784804 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c8b8eb6b-9755-4a22-9f12-eba905d9011a tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d" status: 200 len: 352 microversion: 2.1 time: 0.210164 May 25 15:39:53.789342 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 8/17] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:39:53 2021] GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d => generated 352 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:53.862479 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-699797732", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "networks": [{"uuid": "d995c251-7c0b-4025-9654-f6a6946e8b02"}]}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:39:53.921176 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-14519a04-86bf-4e76-ab1d-caa89de6363a tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f0886340040>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:54.039710 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-14519a04-86bf-4e76-ab1d-caa89de6363a tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb" status: 200 len: 287 microversion: 2.1 time: 0.122250 May 25 15:39:54.040332 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 9/18] 10.222.0.36 () {58 vars in 1251 bytes} [Tue May 25 15:39:53 2021] GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb => generated 287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:39:54.042164 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.network.neutron [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] validate_networks() for [('d995c251-7c0b-4025-9654-f6a6946e8b02', None, None, None)] {{(pid=112576) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:39:54.809879 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-aed201e4-e2e9-4aac-b5ff-cb16da774e94 tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] Calling method '.version_select at 0x7f0886340f70>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:54.998665 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-aed201e4-e2e9-4aac-b5ff-cb16da774e94 tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d" status: 200 len: 352 microversion: 2.1 time: 0.192894 May 25 15:39:54.999840 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 10/19] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:39:54 2021] GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d => generated 352 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:39:55.051961 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a1ad44ca-67d3-48b6-8ee6-49f735eff60e tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f08863403a0>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:55.300145 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a1ad44ca-67d3-48b6-8ee6-49f735eff60e tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb" status: 200 len: 287 microversion: 2.1 time: 0.252479 May 25 15:39:55.304439 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 11/20] 10.222.0.36 () {58 vars in 1251 bytes} [Tue May 25 15:39:55 2021] GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb => generated 287 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:55.814232 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Flavor limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:39:55.814598 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Image limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:39:55.814881 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Flavor pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:39:55.815542 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Image pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:39:55.816704 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:39:55.833597 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:55.834390 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:55.835482 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:55.836265 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:55.865221 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Getting quotas for project 6defbd5b403b44ac8c53cbf324a7f8c9. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:39:55.870907 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Getting quotas for user 40a274a14b0b40189f646c167534de0d and project 6defbd5b403b44ac8c53cbf324a7f8c9. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:39:55.884196 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Going to run 1 instances... {{(pid=112576) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:39:55.887613 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112576) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:39:56.001075 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9eebfd0e-3c63-454c-87fa-e520d6465d7f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.233534 May 25 15:39:56.013027 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 10/21] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:39:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 2241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 15:39:56.013233 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d6a0ac55-a4f8-4105-8b25-e9cac9bff7ba tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] Calling method '.version_select at 0x7f08863a0a60>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:56.019234 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7893b002-5454-4379-8ac7-bc4a895d8452 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:56.028909 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7893b002-5454-4379-8ac7-bc4a895d8452 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:39:56.153397 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-d6a0ac55-a4f8-4105-8b25-e9cac9bff7ba tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] HTTP exception thrown: Volume 79c14512-2ede-4a44-a1dd-0258ac61095d could not be found. May 25 15:39:56.154228 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d6a0ac55-a4f8-4105-8b25-e9cac9bff7ba tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] Returning 404 to user: Volume 79c14512-2ede-4a44-a1dd-0258ac61095d could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:39:56.155453 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d6a0ac55-a4f8-4105-8b25-e9cac9bff7ba tempest-VolumesGetTestJSON-873995914 tempest-VolumesGetTestJSON-873995914-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d" status: 404 len: 109 microversion: 2.1 time: 0.147141 May 25 15:39:56.156379 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 12/22] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:39:56 2021] GET /compute/v2.1/os-volumes/79c14512-2ede-4a44-a1dd-0258ac61095d => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:39:56.312779 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b625a420-8d6c-4219-8618-453dde34a931 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f08863a09d0>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:56.389103 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b625a420-8d6c-4219-8618-453dde34a931 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb" status: 200 len: 288 microversion: 2.1 time: 0.080757 May 25 15:39:56.389679 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 13/23] 10.222.0.36 () {58 vars in 1251 bytes} [Tue May 25 15:39:56 2021] GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb => generated 288 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:39:56.399270 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-591fe246-632e-4e50-b263-3e8ae7e3f0fd tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f0886340310>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:56.789786 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7893b002-5454-4379-8ac7-bc4a895d8452 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:39:56.808270 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7893b002-5454-4379-8ac7-bc4a895d8452 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1214 microversion: 2.1 time: 0.792935 May 25 15:39:56.808882 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 11/24] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:39:56 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1214 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:39:56.826750 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d8275586-50ef-4873-93be-adf97487aed5 tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] Calling method '.version_select at 0x7f08862b1af0>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:56.877849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-591fe246-632e-4e50-b263-3e8ae7e3f0fd tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb" status: 202 len: 0 microversion: 2.1 time: 0.481914 May 25 15:39:56.878950 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 14/25] 10.222.0.36 () {58 vars in 1254 bytes} [Tue May 25 15:39:56 2021] DELETE /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:39:56.887062 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-191982c8-8701-496b-90fc-071914f5e7ed tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f08863a0f70>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:56.976050 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-191982c8-8701-496b-90fc-071914f5e7ed tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb" status: 200 len: 287 microversion: 2.1 time: 0.092908 May 25 15:39:56.976865 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 15/26] 10.222.0.36 () {58 vars in 1251 bytes} [Tue May 25 15:39:56 2021] GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:39:57.046787 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d8275586-50ef-4873-93be-adf97487aed5 tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8bc69c0e-cde5-4c11-b95a-cddfcd7ef89a" status: 200 len: 351 microversion: 2.1 time: 0.236813 May 25 15:39:57.048030 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 12/27] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:39:56 2021] GET /compute/v2.1/os-volumes/8bc69c0e-cde5-4c11-b95a-cddfcd7ef89a => generated 351 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:57.059084 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c0a36041-1a33-40c0-9b1a-d19c96691c1a tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] Calling method '.version_select at 0x7f0886340280>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:57.175676 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c0a36041-1a33-40c0-9b1a-d19c96691c1a tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.120509 May 25 15:39:57.176287 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 16/28] 10.222.0.36 () {58 vars in 1134 bytes} [Tue May 25 15:39:57 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:39:57.189489 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e35217d7-48fe-4482-a53e-a0a137623769 tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] Calling method '.version_select at 0x7f08863a2ca0>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:57.353040 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e35217d7-48fe-4482-a53e-a0a137623769 tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.167210 May 25 15:39:57.353681 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 13/29] 10.222.0.36 () {58 vars in 1149 bytes} [Tue May 25 15:39:57 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:57.367379 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dde85723-6543-485c-b49a-9a18b7e330fa tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] Calling method '.version_select at 0x7f08863a0e50>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:57.543119 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dde85723-6543-485c-b49a-9a18b7e330fa tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.180998 May 25 15:39:57.543690 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 17/30] 10.222.0.36 () {58 vars in 1134 bytes} [Tue May 25 15:39:57 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:39:57.555293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4a58817b-3073-4009-a25f-264cb758c9ad tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] Calling method '.version_select at 0x7f0885a434c0>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:57.736791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4a58817b-3073-4009-a25f-264cb758c9ad tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.184899 May 25 15:39:57.738832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 14/31] 10.222.0.36 () {58 vars in 1167 bytes} [Tue May 25 15:39:57 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:57.751253 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0af91278-32b1-4cb2-85f9-9539bc6c4852 tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] Calling method '.version_select at 0x7f0886344c10>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:57.825822 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-16dee081-4633-4255-a918-aa148f20421f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:57.826470 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-16dee081-4633-4255-a918-aa148f20421f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:39:57.963498 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0af91278-32b1-4cb2-85f9-9539bc6c4852 tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.217193 May 25 15:39:57.970696 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 18/32] 10.222.0.36 () {58 vars in 1170 bytes} [Tue May 25 15:39:57 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:57.975983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-16dee081-4633-4255-a918-aa148f20421f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:39:57.983703 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b67ed8e4-bf27-4d64-abe0-77c314f739bc tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] Calling method '.version_select at 0x7f0886340d30>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:58.010153 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-16dee081-4633-4255-a918-aa148f20421f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1214 microversion: 2.1 time: 0.172754 May 25 15:39:58.011675 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 15/33] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:39:57 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1214 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:39:58.030766 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c9379ead-4e52-4d4e-aeb5-b4ae552878ac tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f08862bdd30>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:58.141648 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c9379ead-4e52-4d4e-aeb5-b4ae552878ac tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb" status: 200 len: 287 microversion: 2.1 time: 0.125560 May 25 15:39:58.142234 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 16/34] 10.222.0.36 () {58 vars in 1251 bytes} [Tue May 25 15:39:58 2021] GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:58.245142 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b67ed8e4-bf27-4d64-abe0-77c314f739bc tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.273009 May 25 15:39:58.246628 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 19/35] 10.222.0.36 () {58 vars in 1155 bytes} [Tue May 25 15:39:57 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:39:58.261766 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e738622c-8ffa-4049-85fb-25a4069b3f80 tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] Calling method '.version_select at 0x7f08862b1280>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:58.458244 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e738622c-8ffa-4049-85fb-25a4069b3f80 tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.203812 May 25 15:39:58.466918 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 17/36] 10.222.0.36 () {58 vars in 1188 bytes} [Tue May 25 15:39:58 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:39:58.475754 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-01ebf47c-4492-4f9e-b5f2-2ab968687ffe tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] Calling method '.version_select at 0x7f08863a04c0>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:58.685512 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-01ebf47c-4492-4f9e-b5f2-2ab968687ffe tempest-VolumesTestJSON-827287820 tempest-VolumesTestJSON-827287820-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.217608 May 25 15:39:58.686104 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 20/37] 10.222.0.36 () {58 vars in 1155 bytes} [Tue May 25 15:39:58 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:39:59.030495 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-302d8141-dbe2-4330-8748-ca1e32f7c78e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:59.031285 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-302d8141-dbe2-4330-8748-ca1e32f7c78e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:39:59.052064 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-302d8141-dbe2-4330-8748-ca1e32f7c78e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:59.052484 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-302d8141-dbe2-4330-8748-ca1e32f7c78e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:59.053317 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-302d8141-dbe2-4330-8748-ca1e32f7c78e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:59.054126 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-302d8141-dbe2-4330-8748-ca1e32f7c78e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:59.155493 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d77d8746-809e-4d13-b1fa-443311d1f69a tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f08863a0dc0>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:39:59.263116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d77d8746-809e-4d13-b1fa-443311d1f69a tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb" status: 200 len: 287 microversion: 2.1 time: 0.112268 May 25 15:39:59.270166 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 21/38] 10.222.0.36 () {58 vars in 1251 bytes} [Tue May 25 15:39:59 2021] GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:39:59.448012 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-302d8141-dbe2-4330-8748-ca1e32f7c78e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:39:59.462108 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-302d8141-dbe2-4330-8748-ca1e32f7c78e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1218 microversion: 2.1 time: 0.436411 May 25 15:39:59.463920 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 18/39] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:39:59 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1218 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:00.285196 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-996980b4-b2ad-4ad9-956f-02840a830039 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f0885a25820>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:00.376834 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-996980b4-b2ad-4ad9-956f-02840a830039 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb" status: 200 len: 287 microversion: 2.1 time: 0.099929 May 25 15:40:00.377427 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 19/40] 10.222.0.36 () {58 vars in 1251 bytes} [Tue May 25 15:40:00 2021] GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:40:00.466668 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a223802f-80a1-4bb1-b373-4c5acf26ff19 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'create', calling method: .version_select at 0x7f08863401f0>, body: {"keypair": {"name": "tempest-keypair-122935831"}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:00.480941 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-18309786-41ff-4060-9cda-541831f0090d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:00.481820 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-18309786-41ff-4060-9cda-541831f0090d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:00.491368 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-18309786-41ff-4060-9cda-541831f0090d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:00.495878 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-18309786-41ff-4060-9cda-541831f0090d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:00.497809 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-18309786-41ff-4060-9cda-541831f0090d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:00.501293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-18309786-41ff-4060-9cda-541831f0090d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:00.544282 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-a223802f-80a1-4bb1-b373-4c5acf26ff19 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Getting quotas for project 42ea914db4fc4438a1d50bfff262a6e8. Resources: {'key_pairs'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:40:00.551452 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-a223802f-80a1-4bb1-b373-4c5acf26ff19 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Getting quotas for user ff91a3b3f9f64b2f8ed2cc67943c1d6e and project 42ea914db4fc4438a1d50bfff262a6e8. Resources: {'key_pairs'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:40:00.757553 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-a223802f-80a1-4bb1-b373-4c5acf26ff19 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Getting quotas for project 42ea914db4fc4438a1d50bfff262a6e8. Resources: {'key_pairs'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:40:00.767515 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-a223802f-80a1-4bb1-b373-4c5acf26ff19 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Getting quotas for user ff91a3b3f9f64b2f8ed2cc67943c1d6e and project 42ea914db4fc4438a1d50bfff262a6e8. Resources: {'key_pairs'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:40:00.784173 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-18309786-41ff-4060-9cda-541831f0090d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:00.795165 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-18309786-41ff-4060-9cda-541831f0090d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1218 microversion: 2.1 time: 0.320177 May 25 15:40:00.800223 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 20/41] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:00 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1218 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:00.808697 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a223802f-80a1-4bb1-b373-4c5acf26ff19 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.778429 May 25 15:40:00.816880 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1158 bytes} [Tue May 25 15:40:00 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:01.389741 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5322667e-e34f-41e3-a6d3-7a15300b9bc9 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f0885a2c670>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:01.543172 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-5322667e-e34f-41e3-a6d3-7a15300b9bc9 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] HTTP exception thrown: Snapshot 6d83143a-6951-42fe-8787-d6493243cecb could not be found. May 25 15:40:01.543800 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5322667e-e34f-41e3-a6d3-7a15300b9bc9 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Returning 404 to user: Snapshot 6d83143a-6951-42fe-8787-d6493243cecb could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:40:01.544886 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5322667e-e34f-41e3-a6d3-7a15300b9bc9 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb" status: 404 len: 111 microversion: 2.1 time: 0.158919 May 25 15:40:01.545646 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 21/43] 10.222.0.36 () {58 vars in 1251 bytes} [Tue May 25 15:40:01 2021] GET /compute/v2.1/os-snapshots/6d83143a-6951-42fe-8787-d6493243cecb => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:40:01.558272 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-72764cab-efb7-479a-8e92-d720af246a9b tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f088631aee0>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:01.819180 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-957df464-f842-497d-9289-2c55a494748b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:01.821080 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-957df464-f842-497d-9289-2c55a494748b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:01.826017 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-72764cab-efb7-479a-8e92-d720af246a9b tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b" status: 202 len: 0 microversion: 2.1 time: 0.273846 May 25 15:40:01.830175 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 23/44] 10.222.0.36 () {58 vars in 1248 bytes} [Tue May 25 15:40:01 2021] DELETE /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:40:01.836139 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-075bc324-761a-43aa-98b5-905292e36b47 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f088633aa60>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:01.853777 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-957df464-f842-497d-9289-2c55a494748b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:01.854169 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-957df464-f842-497d-9289-2c55a494748b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:01.869003 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-957df464-f842-497d-9289-2c55a494748b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:01.871537 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-957df464-f842-497d-9289-2c55a494748b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:02.111789 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-075bc324-761a-43aa-98b5-905292e36b47 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b" status: 200 len: 345 microversion: 2.1 time: 0.280417 May 25 15:40:02.113273 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 24/45] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:40:01 2021] GET /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b => generated 345 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:40:02.212999 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-957df464-f842-497d-9289-2c55a494748b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:02.231286 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-957df464-f842-497d-9289-2c55a494748b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1266 microversion: 2.1 time: 0.420655 May 25 15:40:02.236478 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 22/46] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:01 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:03.125808 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-20972b95-1d70-46c0-a2d6-0d68b3e7f583 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f0885ae63a0>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:03.251224 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1f274839-0534-4903-ad72-0b5bc239aa9a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:03.251965 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1f274839-0534-4903-ad72-0b5bc239aa9a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:03.289021 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1f274839-0534-4903-ad72-0b5bc239aa9a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:03.293060 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1f274839-0534-4903-ad72-0b5bc239aa9a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:03.297923 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1f274839-0534-4903-ad72-0b5bc239aa9a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:03.305572 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1f274839-0534-4903-ad72-0b5bc239aa9a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:03.574059 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-20972b95-1d70-46c0-a2d6-0d68b3e7f583 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] HTTP exception thrown: Volume e8aa5284-521f-4962-a872-6ab90e322a1b could not be found. May 25 15:40:03.574721 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-20972b95-1d70-46c0-a2d6-0d68b3e7f583 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Returning 404 to user: Volume e8aa5284-521f-4962-a872-6ab90e322a1b could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:40:03.575576 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-20972b95-1d70-46c0-a2d6-0d68b3e7f583 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b" status: 404 len: 109 microversion: 2.1 time: 0.454664 May 25 15:40:03.577462 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 25/47] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:40:03 2021] GET /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b => generated 109 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:40:03.603046 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dec04ee7-6616-41d1-8409-1be7332ad1c2 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f088633ab80>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:03.924660 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-dec04ee7-6616-41d1-8409-1be7332ad1c2 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] HTTP exception thrown: Volume e8aa5284-521f-4962-a872-6ab90e322a1b could not be found. May 25 15:40:03.926323 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dec04ee7-6616-41d1-8409-1be7332ad1c2 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Returning 404 to user: Volume e8aa5284-521f-4962-a872-6ab90e322a1b could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:40:03.927612 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dec04ee7-6616-41d1-8409-1be7332ad1c2 tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b" status: 404 len: 109 microversion: 2.1 time: 0.338944 May 25 15:40:03.928744 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 26/48] 10.222.0.36 () {58 vars in 1248 bytes} [Tue May 25 15:40:03 2021] DELETE /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b => generated 109 bytes in 341 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:40:03.938754 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e9c08d4b-fdf4-4987-bbef-6ba90e568fff tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Calling method '.version_select at 0x7f088633aee0>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:04.377003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-e9c08d4b-fdf4-4987-bbef-6ba90e568fff tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] HTTP exception thrown: Volume e8aa5284-521f-4962-a872-6ab90e322a1b could not be found. May 25 15:40:04.377616 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e9c08d4b-fdf4-4987-bbef-6ba90e568fff tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] Returning 404 to user: Volume e8aa5284-521f-4962-a872-6ab90e322a1b could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:40:04.384314 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e9c08d4b-fdf4-4987-bbef-6ba90e568fff tempest-VolumesSnapshotsTestJSON-288235473 tempest-VolumesSnapshotsTestJSON-288235473-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b" status: 404 len: 109 microversion: 2.1 time: 0.445386 May 25 15:40:04.384997 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 27/49] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:40:03 2021] GET /compute/v2.1/os-volumes/e8aa5284-521f-4962-a872-6ab90e322a1b => generated 109 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:40:04.725365 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1f274839-0534-4903-ad72-0b5bc239aa9a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:04.742432 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1f274839-0534-4903-ad72-0b5bc239aa9a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1272 microversion: 2.1 time: 1.495108 May 25 15:40:04.744837 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 23/50] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:03 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1272 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:05.763268 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e28d36eb-bc20-4333-9939-af8879d2f1a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:05.764622 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e28d36eb-bc20-4333-9939-af8879d2f1a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:05.794144 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e28d36eb-bc20-4333-9939-af8879d2f1a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:05.798131 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e28d36eb-bc20-4333-9939-af8879d2f1a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:05.799144 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e28d36eb-bc20-4333-9939-af8879d2f1a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:05.802486 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e28d36eb-bc20-4333-9939-af8879d2f1a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:07.571076 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e28d36eb-bc20-4333-9939-af8879d2f1a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:07.602286 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e28d36eb-bc20-4333-9939-af8879d2f1a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 1.844915 May 25 15:40:07.612771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 28/51] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:05 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:08.618943 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8fd95699-0b51-4ea3-b880-a301f14326de tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:08.620252 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8fd95699-0b51-4ea3-b880-a301f14326de tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:08.631779 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8fd95699-0b51-4ea3-b880-a301f14326de tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:08.634394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8fd95699-0b51-4ea3-b880-a301f14326de tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:08.636576 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8fd95699-0b51-4ea3-b880-a301f14326de tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:08.637610 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8fd95699-0b51-4ea3-b880-a301f14326de tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:08.930722 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1865500583", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db198222-1495-44ec-99cd-cc38de1c71df"}]}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:09.155756 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.network.neutron [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] validate_networks() for [('db198222-1495-44ec-99cd-cc38de1c71df', None, None, None)] {{(pid=112576) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:40:10.357410 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-8fd95699-0b51-4ea3-b880-a301f14326de tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:10.374232 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8fd95699-0b51-4ea3-b880-a301f14326de tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 1.759031 May 25 15:40:10.387379 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 29/52] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:08 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:11.269775 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-12443723", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "320ad3f5-0f83-444c-8df0-70303c7a4446"}], "security_groups": [{"name": "tempest-securitygroup--1613640397"}], "key_name": "tempest-keypair-122935831", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:12.770115 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] validate_networks() for [('320ad3f5-0f83-444c-8df0-70303c7a4446', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:40:13.330733 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Flavor limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:40:13.342707 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Image limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:40:13.351740 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Flavor pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:40:13.355046 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Image pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:40:13.355982 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:40:13.414260 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:13.414260 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:13.414260 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:13.414260 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:13.558611 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Getting quotas for project 0a695c168ea64d4f96c9e8751a6875ca. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:40:13.580347 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Getting quotas for user 89f0526790a544fe8db7acb862c3ccd0 and project 0a695c168ea64d4f96c9e8751a6875ca. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:40:13.617890 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Going to run 1 instances... {{(pid=112576) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:40:13.623445 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112576) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:40:13.769293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.591200 May 25 15:40:13.770088 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 24/53] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:40:08 2021] POST /compute/v2.1/servers => generated 383 bytes in 5598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:40:13.804953 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:13.811425 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:13.852681 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:13.855851 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:13.859594 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:13.864850 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:16.575063 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:16.588726 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 2.810665 May 25 15:40:16.589666 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 25/54] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:13 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 2819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:16.603406 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9bb606a1-4c6b-41a5-81fd-db6e36cca856 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:16.604346 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9bb606a1-4c6b-41a5-81fd-db6e36cca856 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:16.616410 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9bb606a1-4c6b-41a5-81fd-db6e36cca856 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:16.617175 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9bb606a1-4c6b-41a5-81fd-db6e36cca856 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:16.631647 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9bb606a1-4c6b-41a5-81fd-db6e36cca856 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:16.632553 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9bb606a1-4c6b-41a5-81fd-db6e36cca856 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:16.892526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:40:16.894044 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:40:16.894805 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:40:16.895340 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:40:16.895887 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:40:16.914567 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:16.916548 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:16.921751 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:16.925954 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:16.976016 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Getting quotas for project 42ea914db4fc4438a1d50bfff262a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:40:16.993940 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Getting quotas for user ff91a3b3f9f64b2f8ed2cc67943c1d6e and project 42ea914db4fc4438a1d50bfff262a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:40:17.010706 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:40:17.016889 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:40:17.110372 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9bb606a1-4c6b-41a5-81fd-db6e36cca856 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:17.128893 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9bb606a1-4c6b-41a5-81fd-db6e36cca856 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1274 microversion: 2.1 time: 0.535912 May 25 15:40:17.144834 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 26/55] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:16 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1274 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:17.218985 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.955075 May 25 15:40:17.220024 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 30/56] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:40:11 2021] POST /compute/v2.1/servers => generated 402 bytes in 5957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:40:17.492774 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-252a38b9-0f59-43ce-a93f-42a178c48466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76837e96-02fc-46e9-bf8e-a0c0e19c1c19", "tag": "6f230de1-4bde-4abc-ac21-bfe2eddf6700"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:17.495050 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:40:17.495050 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:40:17.521649 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-252a38b9-0f59-43ce-a93f-42a178c48466 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:17.522283 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-252a38b9-0f59-43ce-a93f-42a178c48466 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:17.584042 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-252a38b9-0f59-43ce-a93f-42a178c48466 service nova] Creating event network-changed:6f230de1-4bde-4abc-ac21-bfe2eddf6700 for instance 76837e96-02fc-46e9-bf8e-a0c0e19c1c19 on hv-cinder-79123 May 25 15:40:17.584589 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-252a38b9-0f59-43ce-a93f-42a178c48466 service nova] Acquired lock "compute-rpcapi-router" {{(pid=112577) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 25 15:40:17.585752 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7e9c957d-30f1-45e9-8700-7ec698c19d82 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:17.586208 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7e9c957d-30f1-45e9-8700-7ec698c19d82 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:17.587014 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7e9c957d-30f1-45e9-8700-7ec698c19d82 None None] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:17.587455 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7e9c957d-30f1-45e9-8700-7ec698c19d82 None None] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:17.607921 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0c12e3b4-0a57-435b-925e-4bf8602d1edb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'create', calling method: .version_select at 0x7f08859c4700>, body: {"keypair": {"name": "tempest-keypair-1434779615"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:17.639003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.compute.rpcapi [None req-7e9c957d-30f1-45e9-8700-7ec698c19d82 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 25 15:40:17.639910 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7e9c957d-30f1-45e9-8700-7ec698c19d82 None None] Releasing lock "compute-rpcapi-router" {{(pid=112577) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 25 15:40:17.671192 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-0c12e3b4-0a57-435b-925e-4bf8602d1edb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Getting quotas for project c00f6cd8c3154d2f835d5f59da9cc7e3. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:40:17.689112 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-0c12e3b4-0a57-435b-925e-4bf8602d1edb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Getting quotas for user 4c8848f72ab74290b58ed881102d153e and project c00f6cd8c3154d2f835d5f59da9cc7e3. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:40:17.734768 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7e9c957d-30f1-45e9-8700-7ec698c19d82 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.512127 May 25 15:40:17.736496 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 31/57] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:40:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:40:17.743459 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-deec37c6-3fcb-4ea8-9b34-1b9ec54f9315 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:17.744632 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-deec37c6-3fcb-4ea8-9b34-1b9ec54f9315 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:17.973140 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-deec37c6-3fcb-4ea8-9b34-1b9ec54f9315 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:17.992400 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-deec37c6-3fcb-4ea8-9b34-1b9ec54f9315 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1235 microversion: 2.1 time: 0.253507 May 25 15:40:18.001427 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 32/58] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:17 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1235 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:18.017409 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1879142232", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db198222-1495-44ec-99cd-cc38de1c71df"}]}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:18.286240 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] validate_networks() for [('db198222-1495-44ec-99cd-cc38de1c71df', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:40:18.563495 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-0c12e3b4-0a57-435b-925e-4bf8602d1edb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Getting quotas for project c00f6cd8c3154d2f835d5f59da9cc7e3. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:40:18.571540 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-0c12e3b4-0a57-435b-925e-4bf8602d1edb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Getting quotas for user 4c8848f72ab74290b58ed881102d153e and project c00f6cd8c3154d2f835d5f59da9cc7e3. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:40:18.614335 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0c12e3b4-0a57-435b-925e-4bf8602d1edb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.467093 May 25 15:40:18.617252 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 27/59] 10.222.0.36 () {62 vars in 1199 bytes} [Tue May 25 15:40:17 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1472 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 25 15:40:18.630574 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6ec45b93-5f94-4ac5-af06-b3c7e85aeb00 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:18.638016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6ec45b93-5f94-4ac5-af06-b3c7e85aeb00 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:18.669120 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ec45b93-5f94-4ac5-af06-b3c7e85aeb00 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:18.674731 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ec45b93-5f94-4ac5-af06-b3c7e85aeb00 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:18.682212 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ec45b93-5f94-4ac5-af06-b3c7e85aeb00 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:18.683208 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ec45b93-5f94-4ac5-af06-b3c7e85aeb00 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:19.244399 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6ec45b93-5f94-4ac5-af06-b3c7e85aeb00 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:19.253894 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6ec45b93-5f94-4ac5-af06-b3c7e85aeb00 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 0.632636 May 25 15:40:19.264843 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 28/60] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:18 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:19.270112 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-42e0978a-3c14-4141-98c4-3929fa0098dd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:19.271050 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-42e0978a-3c14-4141-98c4-3929fa0098dd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:19.287407 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-42e0978a-3c14-4141-98c4-3929fa0098dd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:19.293260 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-42e0978a-3c14-4141-98c4-3929fa0098dd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:19.302791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-42e0978a-3c14-4141-98c4-3929fa0098dd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:19.303610 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-42e0978a-3c14-4141-98c4-3929fa0098dd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:19.616609 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-42e0978a-3c14-4141-98c4-3929fa0098dd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:19.630596 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-42e0978a-3c14-4141-98c4-3929fa0098dd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1239 microversion: 2.1 time: 0.363064 May 25 15:40:19.631800 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 29/61] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:19 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1239 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:19.846229 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:40:19.847222 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:40:19.847887 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:40:19.848477 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:40:19.849065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:40:19.865568 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:19.867393 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:19.868447 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:19.871783 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:19.916009 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Getting quotas for project 0a695c168ea64d4f96c9e8751a6875ca. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:40:19.924599 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Getting quotas for user 89f0526790a544fe8db7acb862c3ccd0 and project 0a695c168ea64d4f96c9e8751a6875ca. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:40:19.947941 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:40:19.988750 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:40:20.116230 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9d306c9d-83b1-45f7-b7d1-db71b6095aad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.111106 May 25 15:40:20.121800 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 33/62] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:40:18 2021] POST /compute/v2.1/servers => generated 383 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:40:20.127306 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-32109711-10f1-4018-84d8-43303a42c7bf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:20.128257 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-32109711-10f1-4018-84d8-43303a42c7bf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:20.273389 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8d018506-7b79-4bd4-9408-7163baaefdc8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:20.274421 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8d018506-7b79-4bd4-9408-7163baaefdc8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:20.289388 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8d018506-7b79-4bd4-9408-7163baaefdc8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:20.292647 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8d018506-7b79-4bd4-9408-7163baaefdc8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:20.299526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8d018506-7b79-4bd4-9408-7163baaefdc8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:20.302149 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8d018506-7b79-4bd4-9408-7163baaefdc8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:20.519659 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-32109711-10f1-4018-84d8-43303a42c7bf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:20.528335 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-32109711-10f1-4018-84d8-43303a42c7bf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1222 microversion: 2.1 time: 0.405128 May 25 15:40:20.528934 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 30/63] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:20 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1222 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:20.649060 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0519ee5d-f375-4f77-baa6-50ee15ee8d9b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:20.649855 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0519ee5d-f375-4f77-baa6-50ee15ee8d9b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:20.667135 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0519ee5d-f375-4f77-baa6-50ee15ee8d9b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:20.667607 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0519ee5d-f375-4f77-baa6-50ee15ee8d9b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:20.668446 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0519ee5d-f375-4f77-baa6-50ee15ee8d9b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:20.668905 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0519ee5d-f375-4f77-baa6-50ee15ee8d9b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:21.180794 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-0519ee5d-f375-4f77-baa6-50ee15ee8d9b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:21.193779 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0519ee5d-f375-4f77-baa6-50ee15ee8d9b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1287 microversion: 2.1 time: 0.547083 May 25 15:40:21.194526 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 31/64] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:20 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1287 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:21.367142 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-8d018506-7b79-4bd4-9408-7163baaefdc8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:21.380115 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8d018506-7b79-4bd4-9408-7163baaefdc8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 1.107649 May 25 15:40:21.381238 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 34/65] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:20 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:21.545302 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-aed1a015-a671-45d3-93a8-b1bf91410620 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:21.546185 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-aed1a015-a671-45d3-93a8-b1bf91410620 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:21.567244 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aed1a015-a671-45d3-93a8-b1bf91410620 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:21.572546 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aed1a015-a671-45d3-93a8-b1bf91410620 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:21.573400 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aed1a015-a671-45d3-93a8-b1bf91410620 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:21.573868 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aed1a015-a671-45d3-93a8-b1bf91410620 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:21.900083 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-aed1a015-a671-45d3-93a8-b1bf91410620 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:21.921857 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-aed1a015-a671-45d3-93a8-b1bf91410620 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1274 microversion: 2.1 time: 0.380115 May 25 15:40:21.922448 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 32/66] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:21 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1274 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:22.211649 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8ab17df9-9187-4256-b81f-c05ae71fcee8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:22.212370 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8ab17df9-9187-4256-b81f-c05ae71fcee8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:22.223181 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8ab17df9-9187-4256-b81f-c05ae71fcee8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:22.223655 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8ab17df9-9187-4256-b81f-c05ae71fcee8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:22.224496 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8ab17df9-9187-4256-b81f-c05ae71fcee8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:22.224948 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8ab17df9-9187-4256-b81f-c05ae71fcee8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:22.397358 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a2097a48-c0b2-486a-97d3-430b43153147 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:22.398000 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a2097a48-c0b2-486a-97d3-430b43153147 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:22.407283 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a2097a48-c0b2-486a-97d3-430b43153147 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:22.415898 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a2097a48-c0b2-486a-97d3-430b43153147 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:22.418107 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a2097a48-c0b2-486a-97d3-430b43153147 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:22.419565 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a2097a48-c0b2-486a-97d3-430b43153147 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:23.013561 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-8ab17df9-9187-4256-b81f-c05ae71fcee8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:23.027915 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8ab17df9-9187-4256-b81f-c05ae71fcee8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1293 microversion: 2.1 time: 0.818084 May 25 15:40:23.029071 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 35/67] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:22 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1293 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:23.044031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-769e6ef3-3914-4e9d-aaf7-2c95f2a5a94a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:23.045090 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-769e6ef3-3914-4e9d-aaf7-2c95f2a5a94a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:23.075395 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-769e6ef3-3914-4e9d-aaf7-2c95f2a5a94a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:23.075899 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-769e6ef3-3914-4e9d-aaf7-2c95f2a5a94a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:23.084950 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-769e6ef3-3914-4e9d-aaf7-2c95f2a5a94a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:23.087735 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-769e6ef3-3914-4e9d-aaf7-2c95f2a5a94a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:23.254925 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a2097a48-c0b2-486a-97d3-430b43153147 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:23.267002 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a2097a48-c0b2-486a-97d3-430b43153147 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 0.873368 May 25 15:40:23.279556 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 33/68] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:22 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:23.603642 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-769e6ef3-3914-4e9d-aaf7-2c95f2a5a94a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:23.620294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-769e6ef3-3914-4e9d-aaf7-2c95f2a5a94a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1280 microversion: 2.1 time: 0.587858 May 25 15:40:23.630102 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 36/69] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:23 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1280 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:24.045788 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-90e845f9-2062-48cf-bd5e-67c60655b33d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:24.046429 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-90e845f9-2062-48cf-bd5e-67c60655b33d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:24.063354 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-90e845f9-2062-48cf-bd5e-67c60655b33d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:24.063830 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-90e845f9-2062-48cf-bd5e-67c60655b33d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:24.064671 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-90e845f9-2062-48cf-bd5e-67c60655b33d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:24.065179 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-90e845f9-2062-48cf-bd5e-67c60655b33d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:24.297250 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8bb76058-21a0-4a2e-84a4-9a4929987ea6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:24.298063 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8bb76058-21a0-4a2e-84a4-9a4929987ea6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:24.315038 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8bb76058-21a0-4a2e-84a4-9a4929987ea6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:24.316640 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8bb76058-21a0-4a2e-84a4-9a4929987ea6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:24.317469 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8bb76058-21a0-4a2e-84a4-9a4929987ea6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:24.320145 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8bb76058-21a0-4a2e-84a4-9a4929987ea6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:24.897046 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-90e845f9-2062-48cf-bd5e-67c60655b33d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:24.911891 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-90e845f9-2062-48cf-bd5e-67c60655b33d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.864371 May 25 15:40:24.913195 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 34/70] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:24 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:24.926161 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6829552a-03a0-4430-8dc3-0ff5a98bba4e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:24.927233 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6829552a-03a0-4430-8dc3-0ff5a98bba4e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:24.945876 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6829552a-03a0-4430-8dc3-0ff5a98bba4e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:24.946514 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6829552a-03a0-4430-8dc3-0ff5a98bba4e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:24.947669 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6829552a-03a0-4430-8dc3-0ff5a98bba4e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:24.948299 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6829552a-03a0-4430-8dc3-0ff5a98bba4e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:25.179315 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-8bb76058-21a0-4a2e-84a4-9a4929987ea6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:25.188688 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8bb76058-21a0-4a2e-84a4-9a4929987ea6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 0.896440 May 25 15:40:25.189773 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 37/71] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:24 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:25.928920 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:25.931379 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:25.941971 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:25.943831 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:25.957116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:25.957587 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:26.391615 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6829552a-03a0-4430-8dc3-0ff5a98bba4e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:26.401337 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6829552a-03a0-4430-8dc3-0ff5a98bba4e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 1.486782 May 25 15:40:26.402093 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 35/72] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:24 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:26.407095 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c751ee72-6c52-4150-9730-8ba80080c22e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:26.408048 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c751ee72-6c52-4150-9730-8ba80080c22e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:26.419664 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c751ee72-6c52-4150-9730-8ba80080c22e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:26.420293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c751ee72-6c52-4150-9730-8ba80080c22e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:26.422049 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c751ee72-6c52-4150-9730-8ba80080c22e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:26.423042 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c751ee72-6c52-4150-9730-8ba80080c22e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:27.087660 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:27.105349 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 1.180183 May 25 15:40:27.106569 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 38/73] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:25 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:27.166111 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1198664686", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76bea034-0890-4bf6-b793-280aaec1a32c"}], "security_groups": [{"name": "tempest-securitygroup--1952490476"}], "key_name": "tempest-keypair-1434779615", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:27.285663 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c751ee72-6c52-4150-9730-8ba80080c22e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:27.300375 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c751ee72-6c52-4150-9730-8ba80080c22e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 0.896257 May 25 15:40:27.301634 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 36/74] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:26 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:27.425131 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f80ad1a1-d250-4fbd-94f2-03a81b2f0d7d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:27.427065 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f80ad1a1-d250-4fbd-94f2-03a81b2f0d7d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:27.445127 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f80ad1a1-d250-4fbd-94f2-03a81b2f0d7d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:27.446206 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f80ad1a1-d250-4fbd-94f2-03a81b2f0d7d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:27.447390 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f80ad1a1-d250-4fbd-94f2-03a81b2f0d7d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:27.448015 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f80ad1a1-d250-4fbd-94f2-03a81b2f0d7d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:27.473145 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] validate_networks() for [('76bea034-0890-4bf6-b793-280aaec1a32c', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:40:28.282685 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f80ad1a1-d250-4fbd-94f2-03a81b2f0d7d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:28.298769 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f80ad1a1-d250-4fbd-94f2-03a81b2f0d7d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.882451 May 25 15:40:28.300959 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:40:28.301900 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:40:28.302980 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:40:28.303555 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:40:28.304134 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:40:28.309598 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 37/75] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:27 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:28.316045 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:28.316846 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:28.317707 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:28.318201 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:28.320015 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-c44cd1d0-ecb6-4919-88ab-192f91715408 req-1b5dbb57-4c30-47a9-abf1-6bf4fe8c05de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a5442b-0f3d-41d4-b44f-74e483852fda", "tag": "58598550-b0ed-4b7c-a4d8-2e58f345261c"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:28.322669 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:40:28.322669 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:40:28.336959 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-c44cd1d0-ecb6-4919-88ab-192f91715408 req-1b5dbb57-4c30-47a9-abf1-6bf4fe8c05de service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:28.337614 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-c44cd1d0-ecb6-4919-88ab-192f91715408 req-1b5dbb57-4c30-47a9-abf1-6bf4fe8c05de service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:28.338930 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Getting quotas for project c00f6cd8c3154d2f835d5f59da9cc7e3. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:40:28.343012 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Getting quotas for user 4c8848f72ab74290b58ed881102d153e and project c00f6cd8c3154d2f835d5f59da9cc7e3. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:40:28.355524 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:40:28.358313 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-c44cd1d0-ecb6-4919-88ab-192f91715408 req-1b5dbb57-4c30-47a9-abf1-6bf4fe8c05de service nova] Creating event network-changed:58598550-b0ed-4b7c-a4d8-2e58f345261c for instance 80a5442b-0f3d-41d4-b44f-74e483852fda on hv-cinder-79123 May 25 15:40:28.358910 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-c44cd1d0-ecb6-4919-88ab-192f91715408 req-1b5dbb57-4c30-47a9-abf1-6bf4fe8c05de service nova] Acquired lock "compute-rpcapi-router" {{(pid=112576) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 25 15:40:28.359365 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:40:28.360509 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b215501c-5f62-4223-838d-56784b89f009 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:28.361069 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b215501c-5f62-4223-838d-56784b89f009 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:28.362598 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b215501c-5f62-4223-838d-56784b89f009 None None] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:28.363260 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b215501c-5f62-4223-838d-56784b89f009 None None] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:28.372455 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.compute.rpcapi [None req-b215501c-5f62-4223-838d-56784b89f009 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 25 15:40:28.373826 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b215501c-5f62-4223-838d-56784b89f009 None None] Releasing lock "compute-rpcapi-router" {{(pid=112576) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 25 15:40:28.413629 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b215501c-5f62-4223-838d-56784b89f009 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101523 May 25 15:40:28.414717 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 38/76] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:40:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:40:28.422520 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.260453 May 25 15:40:28.423370 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 39/77] 10.222.0.36 () {62 vars in 1188 bytes} [Tue May 25 15:40:27 2021] POST /compute/v2.1/servers => generated 402 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 15:40:28.428688 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d2319a03-e58c-4d9b-bc25-f4acea66aabd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:28.429408 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d2319a03-e58c-4d9b-bc25-f4acea66aabd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:28.437997 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d2319a03-e58c-4d9b-bc25-f4acea66aabd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:28.438538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d2319a03-e58c-4d9b-bc25-f4acea66aabd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:28.439467 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d2319a03-e58c-4d9b-bc25-f4acea66aabd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:28.440065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d2319a03-e58c-4d9b-bc25-f4acea66aabd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:28.746313 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-f1216f50-f144-4231-a251-ce9dcac7082e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b62e88c-87e4-4020-9fc4-9b2cffdc55de", "tag": "62bd6a93-b70f-4e83-a70a-9b823ecbd7dc"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:28.749144 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:40:28.749144 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:40:28.771163 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-f1216f50-f144-4231-a251-ce9dcac7082e service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:28.772412 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-f1216f50-f144-4231-a251-ce9dcac7082e service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:28.832293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-f1216f50-f144-4231-a251-ce9dcac7082e service nova] Creating event network-changed:62bd6a93-b70f-4e83-a70a-9b823ecbd7dc for instance 1b62e88c-87e4-4020-9fc4-9b2cffdc55de on hv-cinder-79123 May 25 15:40:28.839120 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-f1216f50-f144-4231-a251-ce9dcac7082e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.422177 May 25 15:40:28.841022 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 39/78] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:40:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:40:28.849556 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a84ece26-e981-4750-a0ad-0d6714207bd4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:28.850517 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a84ece26-e981-4750-a0ad-0d6714207bd4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:28.859946 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a84ece26-e981-4750-a0ad-0d6714207bd4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:28.860584 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a84ece26-e981-4750-a0ad-0d6714207bd4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:28.862221 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a84ece26-e981-4750-a0ad-0d6714207bd4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:28.862837 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a84ece26-e981-4750-a0ad-0d6714207bd4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:29.088712 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d2319a03-e58c-4d9b-bc25-f4acea66aabd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:29.105519 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d2319a03-e58c-4d9b-bc25-f4acea66aabd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.678276 May 25 15:40:29.106469 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 40/79] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:28 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:29.115554 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-79bf8e48-a2a3-4c26-98a6-9531a295e029 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:29.117448 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-79bf8e48-a2a3-4c26-98a6-9531a295e029 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:29.242503 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-79bf8e48-a2a3-4c26-98a6-9531a295e029 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:29.251528 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-79bf8e48-a2a3-4c26-98a6-9531a295e029 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:29.253895 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-79bf8e48-a2a3-4c26-98a6-9531a295e029 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:29.255173 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-79bf8e48-a2a3-4c26-98a6-9531a295e029 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1282 microversion: 2.20 time: 0.147695 May 25 15:40:29.255914 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 41/80] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:29 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1282 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:29.304586 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a84ece26-e981-4750-a0ad-0d6714207bd4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:29.317529 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5fffa5c5-0b94-4da3-afcb-e262acfe1a07 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:29.319717 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5fffa5c5-0b94-4da3-afcb-e262acfe1a07 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:29.330325 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a84ece26-e981-4750-a0ad-0d6714207bd4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 0.487318 May 25 15:40:29.330939 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 40/81] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:28 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:29.350384 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5fffa5c5-0b94-4da3-afcb-e262acfe1a07 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:29.350932 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5fffa5c5-0b94-4da3-afcb-e262acfe1a07 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:29.351976 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5fffa5c5-0b94-4da3-afcb-e262acfe1a07 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:29.352545 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5fffa5c5-0b94-4da3-afcb-e262acfe1a07 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:29.805732 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5fffa5c5-0b94-4da3-afcb-e262acfe1a07 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:29.814081 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5fffa5c5-0b94-4da3-afcb-e262acfe1a07 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.501458 May 25 15:40:29.825294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 42/82] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:29 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:30.124568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-08adb502-fc90-4849-80bf-1a6870f82cd8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:30.126037 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-08adb502-fc90-4849-80bf-1a6870f82cd8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:30.136691 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-08adb502-fc90-4849-80bf-1a6870f82cd8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.138636 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-08adb502-fc90-4849-80bf-1a6870f82cd8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.139773 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-08adb502-fc90-4849-80bf-1a6870f82cd8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.140758 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-08adb502-fc90-4849-80bf-1a6870f82cd8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.274521 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-51977735-6bbb-4743-9a77-ee82872cb8ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:30.275394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-51977735-6bbb-4743-9a77-ee82872cb8ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:30.284637 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-51977735-6bbb-4743-9a77-ee82872cb8ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.285104 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-51977735-6bbb-4743-9a77-ee82872cb8ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.286052 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-51977735-6bbb-4743-9a77-ee82872cb8ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.286510 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-51977735-6bbb-4743-9a77-ee82872cb8ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.441173 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-51977735-6bbb-4743-9a77-ee82872cb8ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:30.450808 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-51977735-6bbb-4743-9a77-ee82872cb8ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:30.452470 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-51977735-6bbb-4743-9a77-ee82872cb8ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:30.453597 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-51977735-6bbb-4743-9a77-ee82872cb8ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1286 microversion: 2.20 time: 0.182916 May 25 15:40:30.454159 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 43/83] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:30 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1286 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:40:30.476251 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-08adb502-fc90-4849-80bf-1a6870f82cd8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:30.483737 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-52850869-8fd9-488f-b6e3-3c700c24158d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:30.484556 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-52850869-8fd9-488f-b6e3-3c700c24158d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:30.490775 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-08adb502-fc90-4849-80bf-1a6870f82cd8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.371774 May 25 15:40:30.491381 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 41/84] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:30 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:30.506072 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-52850869-8fd9-488f-b6e3-3c700c24158d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.506707 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-52850869-8fd9-488f-b6e3-3c700c24158d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.507884 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-52850869-8fd9-488f-b6e3-3c700c24158d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.508940 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-52850869-8fd9-488f-b6e3-3c700c24158d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.708016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-4091cac6-5c5c-4d5f-a265-c9f3ea19e198 req-2c97254d-e3c3-4570-976e-315d694637ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76837e96-02fc-46e9-bf8e-a0c0e19c1c19", "name": "network-vif-plugged", "status": "completed", "tag": "6f230de1-4bde-4abc-ac21-bfe2eddf6700"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:30.710474 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:40:30.710474 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:40:30.723933 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-4091cac6-5c5c-4d5f-a265-c9f3ea19e198 req-2c97254d-e3c3-4570-976e-315d694637ad service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.724574 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-4091cac6-5c5c-4d5f-a265-c9f3ea19e198 req-2c97254d-e3c3-4570-976e-315d694637ad service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.767879 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-4091cac6-5c5c-4d5f-a265-c9f3ea19e198 req-2c97254d-e3c3-4570-976e-315d694637ad service nova] Creating event network-vif-plugged:6f230de1-4bde-4abc-ac21-bfe2eddf6700 for instance 76837e96-02fc-46e9-bf8e-a0c0e19c1c19 on hv-cinder-79123 May 25 15:40:30.776344 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-4091cac6-5c5c-4d5f-a265-c9f3ea19e198 req-2c97254d-e3c3-4570-976e-315d694637ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158354 May 25 15:40:30.777465 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 42/85] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:40:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:40:30.802076 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-52850869-8fd9-488f-b6e3-3c700c24158d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:30.814945 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-52850869-8fd9-488f-b6e3-3c700c24158d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 0.349693 May 25 15:40:30.815820 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 44/86] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:30 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:30.834572 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d12f235d-8396-45be-a6bb-881afca274c8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:30.835806 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d12f235d-8396-45be-a6bb-881afca274c8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:30.851202 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d12f235d-8396-45be-a6bb-881afca274c8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.853219 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d12f235d-8396-45be-a6bb-881afca274c8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.854479 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d12f235d-8396-45be-a6bb-881afca274c8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.855086 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d12f235d-8396-45be-a6bb-881afca274c8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.871398 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-198aa571-2420-4884-bcf8-4d804486cc3f req-5ecbad72-14b1-48fe-bcf3-5c37e0e53016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92aed9d5-56b6-4cbf-9678-b16f7de68b23", "tag": "cfbb7459-c8f7-4441-8886-be2a6b4ad1a7"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:30.873949 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:40:30.873949 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:40:30.894204 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-198aa571-2420-4884-bcf8-4d804486cc3f req-5ecbad72-14b1-48fe-bcf3-5c37e0e53016 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.894985 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-198aa571-2420-4884-bcf8-4d804486cc3f req-5ecbad72-14b1-48fe-bcf3-5c37e0e53016 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.934704 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-198aa571-2420-4884-bcf8-4d804486cc3f req-5ecbad72-14b1-48fe-bcf3-5c37e0e53016 service nova] Creating event network-changed:cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 for instance 92aed9d5-56b6-4cbf-9678-b16f7de68b23 on hv-cinder-79123 May 25 15:40:30.941663 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-198aa571-2420-4884-bcf8-4d804486cc3f req-5ecbad72-14b1-48fe-bcf3-5c37e0e53016 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074999 May 25 15:40:30.943345 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 45/87] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:40:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:40:31.100404 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d12f235d-8396-45be-a6bb-881afca274c8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:31.108620 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d12f235d-8396-45be-a6bb-881afca274c8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.279460 May 25 15:40:31.109196 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 43/88] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:30 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:31.472413 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ce9440a4-4866-4433-9c5c-5d5f66d53b76 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:31.473753 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ce9440a4-4866-4433-9c5c-5d5f66d53b76 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:31.482047 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce9440a4-4866-4433-9c5c-5d5f66d53b76 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:31.482522 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce9440a4-4866-4433-9c5c-5d5f66d53b76 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:31.483327 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce9440a4-4866-4433-9c5c-5d5f66d53b76 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:31.483785 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce9440a4-4866-4433-9c5c-5d5f66d53b76 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:31.509702 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-091b21aa-440a-4893-b9ab-b82c9dda6f94 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:31.510345 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-091b21aa-440a-4893-b9ab-b82c9dda6f94 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:31.519091 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-091b21aa-440a-4893-b9ab-b82c9dda6f94 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:31.519677 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-091b21aa-440a-4893-b9ab-b82c9dda6f94 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:31.520612 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-091b21aa-440a-4893-b9ab-b82c9dda6f94 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:31.521366 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-091b21aa-440a-4893-b9ab-b82c9dda6f94 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:31.605644 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ce9440a4-4866-4433-9c5c-5d5f66d53b76 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:31.615573 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ce9440a4-4866-4433-9c5c-5d5f66d53b76 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:31.617384 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ce9440a4-4866-4433-9c5c-5d5f66d53b76 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:31.618780 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ce9440a4-4866-4433-9c5c-5d5f66d53b76 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1286 microversion: 2.20 time: 0.151189 May 25 15:40:31.627392 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 46/89] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:31 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1286 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:31.724532 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-091b21aa-440a-4893-b9ab-b82c9dda6f94 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:31.735452 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-091b21aa-440a-4893-b9ab-b82c9dda6f94 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.227773 May 25 15:40:31.736380 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 44/90] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:31 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:31.833330 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e346219c-2540-4c36-b2ce-ea93f6c73a47 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:31.834141 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e346219c-2540-4c36-b2ce-ea93f6c73a47 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:31.841687 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e346219c-2540-4c36-b2ce-ea93f6c73a47 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:31.842156 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e346219c-2540-4c36-b2ce-ea93f6c73a47 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:31.842993 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e346219c-2540-4c36-b2ce-ea93f6c73a47 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:31.843447 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e346219c-2540-4c36-b2ce-ea93f6c73a47 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:32.125599 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-10c0cbe2-b051-42e2-9ab0-8bb70a2ab7d4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:32.126392 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-10c0cbe2-b051-42e2-9ab0-8bb70a2ab7d4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:32.141544 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-10c0cbe2-b051-42e2-9ab0-8bb70a2ab7d4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:32.142523 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-10c0cbe2-b051-42e2-9ab0-8bb70a2ab7d4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:32.149742 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-10c0cbe2-b051-42e2-9ab0-8bb70a2ab7d4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:32.149742 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-10c0cbe2-b051-42e2-9ab0-8bb70a2ab7d4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:32.657005 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e346219c-2540-4c36-b2ce-ea93f6c73a47 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:32.669270 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e346219c-2540-4c36-b2ce-ea93f6c73a47 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 0.838472 May 25 15:40:32.669889 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 47/91] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:31 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:32.683444 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-37a939b3-6fb8-40f3-a339-a0d12fff5e71 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:32.684148 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-37a939b3-6fb8-40f3-a339-a0d12fff5e71 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:32.694001 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-37a939b3-6fb8-40f3-a339-a0d12fff5e71 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:32.694386 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-37a939b3-6fb8-40f3-a339-a0d12fff5e71 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:32.695191 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-37a939b3-6fb8-40f3-a339-a0d12fff5e71 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:32.698686 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-37a939b3-6fb8-40f3-a339-a0d12fff5e71 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:32.768344 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-10c0cbe2-b051-42e2-9ab0-8bb70a2ab7d4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:32.792427 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-10c0cbe2-b051-42e2-9ab0-8bb70a2ab7d4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.670377 May 25 15:40:32.809606 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 45/92] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:32 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:32.838217 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-64c72f89-ce46-43a9-8ea6-66355a683c2d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:32.852325 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-64c72f89-ce46-43a9-8ea6-66355a683c2d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:32.865641 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-64c72f89-ce46-43a9-8ea6-66355a683c2d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:32.866313 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-64c72f89-ce46-43a9-8ea6-66355a683c2d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:32.867833 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-64c72f89-ce46-43a9-8ea6-66355a683c2d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:32.870056 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-64c72f89-ce46-43a9-8ea6-66355a683c2d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:33.123324 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-37a939b3-6fb8-40f3-a339-a0d12fff5e71 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:33.138347 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-37a939b3-6fb8-40f3-a339-a0d12fff5e71 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:33.143107 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-37a939b3-6fb8-40f3-a339-a0d12fff5e71 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:33.148907 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-37a939b3-6fb8-40f3-a339-a0d12fff5e71 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1334 microversion: 2.20 time: 0.475693 May 25 15:40:33.149738 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 48/93] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:32 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1334 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:33.688092 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d15eb3ae-6b1c-4a06-a62e-da6eddbc96a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:33.688788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d15eb3ae-6b1c-4a06-a62e-da6eddbc96a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:33.708191 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d15eb3ae-6b1c-4a06-a62e-da6eddbc96a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:33.709629 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d15eb3ae-6b1c-4a06-a62e-da6eddbc96a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:33.712666 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d15eb3ae-6b1c-4a06-a62e-da6eddbc96a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:33.713184 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d15eb3ae-6b1c-4a06-a62e-da6eddbc96a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:33.876413 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-64c72f89-ce46-43a9-8ea6-66355a683c2d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:33.890594 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-64c72f89-ce46-43a9-8ea6-66355a683c2d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 1.079644 May 25 15:40:33.891179 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 46/94] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:32 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:33.913193 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-38dbb551-65a9-4414-a4c8-0b8b270bcf60 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:33.913819 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-38dbb551-65a9-4414-a4c8-0b8b270bcf60 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:33.925372 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-38dbb551-65a9-4414-a4c8-0b8b270bcf60 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:33.926916 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-38dbb551-65a9-4414-a4c8-0b8b270bcf60 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:33.927728 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-38dbb551-65a9-4414-a4c8-0b8b270bcf60 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:33.928382 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-38dbb551-65a9-4414-a4c8-0b8b270bcf60 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:34.247558 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d15eb3ae-6b1c-4a06-a62e-da6eddbc96a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:34.253623 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-38dbb551-65a9-4414-a4c8-0b8b270bcf60 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:34.256617 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d15eb3ae-6b1c-4a06-a62e-da6eddbc96a4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 0.572687 May 25 15:40:34.257189 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 49/95] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:33 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:34.261963 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2ed2420f-a95c-4cb0-9c27-d8271ec5dda2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:34.262886 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2ed2420f-a95c-4cb0-9c27-d8271ec5dda2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:34.270142 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-38dbb551-65a9-4414-a4c8-0b8b270bcf60 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.377531 May 25 15:40:34.270975 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 47/96] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:33 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:34.280484 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2ed2420f-a95c-4cb0-9c27-d8271ec5dda2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:34.281111 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2ed2420f-a95c-4cb0-9c27-d8271ec5dda2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:34.281918 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2ed2420f-a95c-4cb0-9c27-d8271ec5dda2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:34.282360 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2ed2420f-a95c-4cb0-9c27-d8271ec5dda2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:34.402520 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2ed2420f-a95c-4cb0-9c27-d8271ec5dda2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:34.415343 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2ed2420f-a95c-4cb0-9c27-d8271ec5dda2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:34.417610 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2ed2420f-a95c-4cb0-9c27-d8271ec5dda2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:34.418893 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2ed2420f-a95c-4cb0-9c27-d8271ec5dda2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1340 microversion: 2.20 time: 0.160501 May 25 15:40:34.419630 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 50/97] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:34 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1340 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:34.906512 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-41cbd0ad-4d03-42ad-bf59-9aa7da0adf15 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:34.907310 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-41cbd0ad-4d03-42ad-bf59-9aa7da0adf15 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:34.929185 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-41cbd0ad-4d03-42ad-bf59-9aa7da0adf15 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:34.929482 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-41cbd0ad-4d03-42ad-bf59-9aa7da0adf15 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:34.930788 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-41cbd0ad-4d03-42ad-bf59-9aa7da0adf15 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:34.931733 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-41cbd0ad-4d03-42ad-bf59-9aa7da0adf15 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:35.165958 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-41cbd0ad-4d03-42ad-bf59-9aa7da0adf15 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:35.176264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-41cbd0ad-4d03-42ad-bf59-9aa7da0adf15 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.273297 May 25 15:40:35.177110 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 48/98] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:34 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:35.274485 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c6a3b146-b446-48ed-adb0-4ee8da8e6f38 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:35.275454 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c6a3b146-b446-48ed-adb0-4ee8da8e6f38 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:35.284805 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c6a3b146-b446-48ed-adb0-4ee8da8e6f38 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:35.285486 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c6a3b146-b446-48ed-adb0-4ee8da8e6f38 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:35.286599 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c6a3b146-b446-48ed-adb0-4ee8da8e6f38 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:35.286756 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-53a1e6fa-83de-46c8-b8f4-50b6d8aba8dc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:35.287403 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c6a3b146-b446-48ed-adb0-4ee8da8e6f38 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:35.287749 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-53a1e6fa-83de-46c8-b8f4-50b6d8aba8dc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:35.299105 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-53a1e6fa-83de-46c8-b8f4-50b6d8aba8dc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:35.301315 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-53a1e6fa-83de-46c8-b8f4-50b6d8aba8dc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:35.303466 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-53a1e6fa-83de-46c8-b8f4-50b6d8aba8dc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:35.306200 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-53a1e6fa-83de-46c8-b8f4-50b6d8aba8dc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:35.546999 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-53a1e6fa-83de-46c8-b8f4-50b6d8aba8dc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:35.555679 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-53a1e6fa-83de-46c8-b8f4-50b6d8aba8dc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.272937 May 25 15:40:35.556216 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 49/99] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:35 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:35.569423 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c0965732-9e6a-468a-b2fd-5d815091b4e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:35.570043 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c0965732-9e6a-468a-b2fd-5d815091b4e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:35.577538 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c0965732-9e6a-468a-b2fd-5d815091b4e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:35.578126 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c0965732-9e6a-468a-b2fd-5d815091b4e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:35.578908 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c0965732-9e6a-468a-b2fd-5d815091b4e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:35.579346 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c0965732-9e6a-468a-b2fd-5d815091b4e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:35.656840 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c6a3b146-b446-48ed-adb0-4ee8da8e6f38 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:35.666061 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c6a3b146-b446-48ed-adb0-4ee8da8e6f38 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 0.396117 May 25 15:40:35.666645 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 51/100] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:35 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:35.714449 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c0965732-9e6a-468a-b2fd-5d815091b4e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:35.723885 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c0965732-9e6a-468a-b2fd-5d815091b4e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:35.725629 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c0965732-9e6a-468a-b2fd-5d815091b4e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:35.726906 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c0965732-9e6a-468a-b2fd-5d815091b4e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1340 microversion: 2.20 time: 0.161063 May 25 15:40:35.727502 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 50/101] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:35 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1340 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:36.193338 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-636138d2-09b6-48d4-a39a-532476577736 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:36.193974 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-636138d2-09b6-48d4-a39a-532476577736 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:36.201233 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-636138d2-09b6-48d4-a39a-532476577736 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:36.201688 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-636138d2-09b6-48d4-a39a-532476577736 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:36.202631 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-636138d2-09b6-48d4-a39a-532476577736 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:36.203073 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-636138d2-09b6-48d4-a39a-532476577736 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:36.418442 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-636138d2-09b6-48d4-a39a-532476577736 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:36.427820 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-636138d2-09b6-48d4-a39a-532476577736 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.238741 May 25 15:40:36.428423 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 52/102] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:36 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:36.572746 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-cbe2a6c3-67a5-48a2-a3ae-9d23aabc9ab8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:36.573814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-cbe2a6c3-67a5-48a2-a3ae-9d23aabc9ab8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:36.585820 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cbe2a6c3-67a5-48a2-a3ae-9d23aabc9ab8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:36.586501 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cbe2a6c3-67a5-48a2-a3ae-9d23aabc9ab8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:36.590172 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cbe2a6c3-67a5-48a2-a3ae-9d23aabc9ab8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:36.590172 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cbe2a6c3-67a5-48a2-a3ae-9d23aabc9ab8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:36.682817 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4777ed36-3540-4864-8bfc-b5028b507ada tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:36.683442 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4777ed36-3540-4864-8bfc-b5028b507ada tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:36.691904 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4777ed36-3540-4864-8bfc-b5028b507ada tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:36.692547 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4777ed36-3540-4864-8bfc-b5028b507ada tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:36.693655 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4777ed36-3540-4864-8bfc-b5028b507ada tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:36.694553 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4777ed36-3540-4864-8bfc-b5028b507ada tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:36.807121 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-cbe2a6c3-67a5-48a2-a3ae-9d23aabc9ab8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:36.818823 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-cbe2a6c3-67a5-48a2-a3ae-9d23aabc9ab8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.250332 May 25 15:40:36.819827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 51/103] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:36 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:36.825876 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-15030781-9e11-4bc8-b45d-a54950799115 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:36.826742 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-15030781-9e11-4bc8-b45d-a54950799115 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:36.849840 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-15030781-9e11-4bc8-b45d-a54950799115 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:36.853264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-15030781-9e11-4bc8-b45d-a54950799115 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:36.857075 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-15030781-9e11-4bc8-b45d-a54950799115 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:36.857718 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-15030781-9e11-4bc8-b45d-a54950799115 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:36.952214 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4777ed36-3540-4864-8bfc-b5028b507ada tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:36.962846 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4777ed36-3540-4864-8bfc-b5028b507ada tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 0.283410 May 25 15:40:36.964122 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 53/104] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:36 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:37.008105 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-15030781-9e11-4bc8-b45d-a54950799115 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:37.018004 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-15030781-9e11-4bc8-b45d-a54950799115 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:37.020154 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-15030781-9e11-4bc8-b45d-a54950799115 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:37.021419 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-15030781-9e11-4bc8-b45d-a54950799115 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1340 microversion: 2.20 time: 0.200181 May 25 15:40:37.022696 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 52/105] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:36 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:37.449502 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ce1d46c8-b608-45ed-919d-b1345e9bea61 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:37.450967 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ce1d46c8-b608-45ed-919d-b1345e9bea61 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:37.470109 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce1d46c8-b608-45ed-919d-b1345e9bea61 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:37.470767 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce1d46c8-b608-45ed-919d-b1345e9bea61 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:37.472766 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce1d46c8-b608-45ed-919d-b1345e9bea61 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:37.473399 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce1d46c8-b608-45ed-919d-b1345e9bea61 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:37.835002 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-af9dc2bf-0720-483a-860e-e62a28fdcaa0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:37.836131 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-af9dc2bf-0720-483a-860e-e62a28fdcaa0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:37.844716 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-af9dc2bf-0720-483a-860e-e62a28fdcaa0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:37.845590 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-af9dc2bf-0720-483a-860e-e62a28fdcaa0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:37.847398 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-af9dc2bf-0720-483a-860e-e62a28fdcaa0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:37.848009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-af9dc2bf-0720-483a-860e-e62a28fdcaa0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:38.259776 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ce1d46c8-b608-45ed-919d-b1345e9bea61 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:38.282471 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-af9dc2bf-0720-483a-860e-e62a28fdcaa0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:38.292427 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ce1d46c8-b608-45ed-919d-b1345e9bea61 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.850206 May 25 15:40:38.296831 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 54/106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:37 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:38.307155 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-af9dc2bf-0720-483a-860e-e62a28fdcaa0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.475617 May 25 15:40:38.316647 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 53/107] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:37 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:38.330592 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3ec0ed38-16fd-4629-a03b-4f44134b15ea tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:38.332079 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3ec0ed38-16fd-4629-a03b-4f44134b15ea tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:38.334775 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-88188e85-3043-41a8-8080-3084cb6e9fd9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:38.335429 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-88188e85-3043-41a8-8080-3084cb6e9fd9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:38.355563 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3ec0ed38-16fd-4629-a03b-4f44134b15ea tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:38.356626 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3ec0ed38-16fd-4629-a03b-4f44134b15ea tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:38.357427 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-88188e85-3043-41a8-8080-3084cb6e9fd9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:38.359396 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-88188e85-3043-41a8-8080-3084cb6e9fd9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:38.360192 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3ec0ed38-16fd-4629-a03b-4f44134b15ea tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:38.360799 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3ec0ed38-16fd-4629-a03b-4f44134b15ea tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:38.362118 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-88188e85-3043-41a8-8080-3084cb6e9fd9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:38.367109 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-88188e85-3043-41a8-8080-3084cb6e9fd9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:38.505517 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-88188e85-3043-41a8-8080-3084cb6e9fd9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:38.519208 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-88188e85-3043-41a8-8080-3084cb6e9fd9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:38.521827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-88188e85-3043-41a8-8080-3084cb6e9fd9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:38.523201 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-88188e85-3043-41a8-8080-3084cb6e9fd9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1340 microversion: 2.20 time: 0.204987 May 25 15:40:38.534662 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 54/108] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:38 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1340 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:38.989323 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3ec0ed38-16fd-4629-a03b-4f44134b15ea tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:39.000301 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3ec0ed38-16fd-4629-a03b-4f44134b15ea tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1314 microversion: 2.1 time: 0.701812 May 25 15:40:39.003112 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 55/109] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:38 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:39.309139 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b6e37f8b-e737-4929-a4fb-caaac6bd6fe5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:39.309764 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b6e37f8b-e737-4929-a4fb-caaac6bd6fe5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:39.326161 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dcb30e6b-04d0-4e45-bd23-0987a1121d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:39.326795 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-dcb30e6b-04d0-4e45-bd23-0987a1121d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:39.340857 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b6e37f8b-e737-4929-a4fb-caaac6bd6fe5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:39.341322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b6e37f8b-e737-4929-a4fb-caaac6bd6fe5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:39.344433 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dcb30e6b-04d0-4e45-bd23-0987a1121d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:39.355232 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b6e37f8b-e737-4929-a4fb-caaac6bd6fe5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:39.364377 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dcb30e6b-04d0-4e45-bd23-0987a1121d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:39.374378 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b6e37f8b-e737-4929-a4fb-caaac6bd6fe5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:39.377205 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dcb30e6b-04d0-4e45-bd23-0987a1121d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:39.377794 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dcb30e6b-04d0-4e45-bd23-0987a1121d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:39.797715 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b6e37f8b-e737-4929-a4fb-caaac6bd6fe5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:39.810395 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b6e37f8b-e737-4929-a4fb-caaac6bd6fe5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.504972 May 25 15:40:39.812305 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 55/110] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:39 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:39.819630 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-92874306-9224-45fd-bfa1-e0ed9673e33e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:39.820525 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-92874306-9224-45fd-bfa1-e0ed9673e33e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:39.831993 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-92874306-9224-45fd-bfa1-e0ed9673e33e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:39.833169 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-92874306-9224-45fd-bfa1-e0ed9673e33e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:39.834360 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-92874306-9224-45fd-bfa1-e0ed9673e33e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:39.835068 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-92874306-9224-45fd-bfa1-e0ed9673e33e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:40.007404 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-dcb30e6b-04d0-4e45-bd23-0987a1121d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:40.022724 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dcb30e6b-04d0-4e45-bd23-0987a1121d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.700347 May 25 15:40:40.023321 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 56/111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:39 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:40.030557 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7d19ee49-a0fe-4a84-bed2-005b86ff9aef tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:40.031662 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7d19ee49-a0fe-4a84-bed2-005b86ff9aef tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:40.043128 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7d19ee49-a0fe-4a84-bed2-005b86ff9aef tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:40.043679 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7d19ee49-a0fe-4a84-bed2-005b86ff9aef tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:40.044995 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7d19ee49-a0fe-4a84-bed2-005b86ff9aef tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:40.045533 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7d19ee49-a0fe-4a84-bed2-005b86ff9aef tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:40.253775 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-92874306-9224-45fd-bfa1-e0ed9673e33e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:40.263412 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-92874306-9224-45fd-bfa1-e0ed9673e33e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:40.265130 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-92874306-9224-45fd-bfa1-e0ed9673e33e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:40.266405 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-92874306-9224-45fd-bfa1-e0ed9673e33e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1408 microversion: 2.20 time: 0.452812 May 25 15:40:40.277999 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 56/112] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:39 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1408 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:40.465201 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7d19ee49-a0fe-4a84-bed2-005b86ff9aef tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:40.474275 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7d19ee49-a0fe-4a84-bed2-005b86ff9aef tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1502 microversion: 2.1 time: 0.449608 May 25 15:40:40.475031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 57/113] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:40 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1502 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:40.829779 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-479288ad-f9b2-4411-8e43-991169036190 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:40.830417 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-479288ad-f9b2-4411-8e43-991169036190 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:40.842842 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-479288ad-f9b2-4411-8e43-991169036190 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:40.843533 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-479288ad-f9b2-4411-8e43-991169036190 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:40.844928 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-479288ad-f9b2-4411-8e43-991169036190 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:40.845879 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-479288ad-f9b2-4411-8e43-991169036190 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:41.038539 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e88f49b9-5e75-4007-a90d-c7d7dd00481b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:41.039174 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e88f49b9-5e75-4007-a90d-c7d7dd00481b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:41.060433 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e88f49b9-5e75-4007-a90d-c7d7dd00481b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:41.066641 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e88f49b9-5e75-4007-a90d-c7d7dd00481b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:41.067875 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e88f49b9-5e75-4007-a90d-c7d7dd00481b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:41.068476 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e88f49b9-5e75-4007-a90d-c7d7dd00481b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:41.589627 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-479288ad-f9b2-4411-8e43-991169036190 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:41.606534 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-479288ad-f9b2-4411-8e43-991169036190 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.779842 May 25 15:40:41.619056 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 57/114] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:40 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:41.629258 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-1547634d-df43-43c8-aecd-92d402c51734 req-960556ce-0dac-46f9-a36c-e58be444e332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9301f1db-ecb0-465b-858c-64a2bfd4d5cb", "tag": "3f734a1c-be04-4203-b351-6b0b6785f9ae"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:41.634457 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:40:41.634457 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:40:41.667123 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-1547634d-df43-43c8-aecd-92d402c51734 req-960556ce-0dac-46f9-a36c-e58be444e332 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:41.672432 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-1547634d-df43-43c8-aecd-92d402c51734 req-960556ce-0dac-46f9-a36c-e58be444e332 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:41.674742 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e88f49b9-5e75-4007-a90d-c7d7dd00481b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:41.683722 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e88f49b9-5e75-4007-a90d-c7d7dd00481b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.648947 May 25 15:40:41.702232 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 58/115] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:41 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:41.703012 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-1547634d-df43-43c8-aecd-92d402c51734 req-960556ce-0dac-46f9-a36c-e58be444e332 service nova] Creating event network-changed:3f734a1c-be04-4203-b351-6b0b6785f9ae for instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb on hv-cinder-79123 May 25 15:40:41.709986 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-02033166-4ca5-49bf-a7dd-03d27b604c3e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:41.710247 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-1547634d-df43-43c8-aecd-92d402c51734 req-960556ce-0dac-46f9-a36c-e58be444e332 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089443 May 25 15:40:41.710607 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-02033166-4ca5-49bf-a7dd-03d27b604c3e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:41.711000 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 58/116] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:40:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:40:41.723250 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02033166-4ca5-49bf-a7dd-03d27b604c3e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:41.724794 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02033166-4ca5-49bf-a7dd-03d27b604c3e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:41.726534 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02033166-4ca5-49bf-a7dd-03d27b604c3e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:41.727523 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02033166-4ca5-49bf-a7dd-03d27b604c3e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:42.221678 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-02033166-4ca5-49bf-a7dd-03d27b604c3e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:42.235215 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-02033166-4ca5-49bf-a7dd-03d27b604c3e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:42.237003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-02033166-4ca5-49bf-a7dd-03d27b604c3e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:42.240395 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-02033166-4ca5-49bf-a7dd-03d27b604c3e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1408 microversion: 2.20 time: 0.543732 May 25 15:40:42.240985 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 59/117] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:41 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1408 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:42.485335 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-98361f8d-c1cf-4655-a249-f0cbb166f62a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70f61136-442e-4549-8837-301dc7abe573"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:42.487291 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-98361f8d-c1cf-4655-a249-f0cbb166f62a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:42.506365 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-98361f8d-c1cf-4655-a249-f0cbb166f62a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:42.508182 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-98361f8d-c1cf-4655-a249-f0cbb166f62a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:42.512392 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-98361f8d-c1cf-4655-a249-f0cbb166f62a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:42.513013 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-98361f8d-c1cf-4655-a249-f0cbb166f62a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:42.625520 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-906c85b6-9348-414b-bb05-25d6156e46f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:42.626459 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-906c85b6-9348-414b-bb05-25d6156e46f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:42.640142 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-906c85b6-9348-414b-bb05-25d6156e46f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:42.640875 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-906c85b6-9348-414b-bb05-25d6156e46f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:42.642780 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-906c85b6-9348-414b-bb05-25d6156e46f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:42.648723 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-906c85b6-9348-414b-bb05-25d6156e46f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:43.241903 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-906c85b6-9348-414b-bb05-25d6156e46f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:43.251426 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-906c85b6-9348-414b-bb05-25d6156e46f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.630577 May 25 15:40:43.261596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 60/118] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:42 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:43.272779 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f5b138e3-b359-4285-905b-d3ca84c29293 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:43.273380 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f5b138e3-b359-4285-905b-d3ca84c29293 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:43.301890 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f5b138e3-b359-4285-905b-d3ca84c29293 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:43.302355 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f5b138e3-b359-4285-905b-d3ca84c29293 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:43.303408 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f5b138e3-b359-4285-905b-d3ca84c29293 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:43.303633 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f5b138e3-b359-4285-905b-d3ca84c29293 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:43.388166 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-98361f8d-c1cf-4655-a249-f0cbb166f62a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "POST /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.906888 May 25 15:40:43.388823 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 59/119] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:40:42 2021] POST /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19/os-volume_attachments => generated 194 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:40:43.414377 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f8409a92-0662-4a49-828f-077ed4a88d18 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:43.415034 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f8409a92-0662-4a49-828f-077ed4a88d18 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:43.442684 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f8409a92-0662-4a49-828f-077ed4a88d18 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:43.443216 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f8409a92-0662-4a49-828f-077ed4a88d18 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:43.444088 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f8409a92-0662-4a49-828f-077ed4a88d18 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:43.444540 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f8409a92-0662-4a49-828f-077ed4a88d18 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:43.910764 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f8409a92-0662-4a49-828f-077ed4a88d18 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:43.922537 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f8409a92-0662-4a49-828f-077ed4a88d18 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:43.924170 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f8409a92-0662-4a49-828f-077ed4a88d18 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:43.926283 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f8409a92-0662-4a49-828f-077ed4a88d18 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1408 microversion: 2.20 time: 0.535771 May 25 15:40:43.926964 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 60/120] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:43 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1408 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:43.948696 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f5b138e3-b359-4285-905b-d3ca84c29293 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:43.961142 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f5b138e3-b359-4285-905b-d3ca84c29293 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.693327 May 25 15:40:43.962171 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 61/121] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:43 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:44.277028 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-03145613-3e08-41ad-94e1-e1e676da5937 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:44.277799 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-03145613-3e08-41ad-94e1-e1e676da5937 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:44.286060 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-03145613-3e08-41ad-94e1-e1e676da5937 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:44.286633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-03145613-3e08-41ad-94e1-e1e676da5937 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:44.287505 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-03145613-3e08-41ad-94e1-e1e676da5937 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:44.288071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-03145613-3e08-41ad-94e1-e1e676da5937 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:44.500224 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-03145613-3e08-41ad-94e1-e1e676da5937 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:44.509096 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-03145613-3e08-41ad-94e1-e1e676da5937 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.235493 May 25 15:40:44.509838 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 61/122] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:44 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:44.954890 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-afc79e29-236f-4067-aff1-23d70b0eb4e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:44.955541 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-afc79e29-236f-4067-aff1-23d70b0eb4e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:44.962986 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-afc79e29-236f-4067-aff1-23d70b0eb4e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:44.963445 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-afc79e29-236f-4067-aff1-23d70b0eb4e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:44.964247 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-afc79e29-236f-4067-aff1-23d70b0eb4e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:44.964688 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-afc79e29-236f-4067-aff1-23d70b0eb4e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:44.978598 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2401b34c-f42b-4b26-af64-b7ffb8be74d5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:44.980256 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2401b34c-f42b-4b26-af64-b7ffb8be74d5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:44.990708 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2401b34c-f42b-4b26-af64-b7ffb8be74d5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:44.991499 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2401b34c-f42b-4b26-af64-b7ffb8be74d5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:44.992480 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2401b34c-f42b-4b26-af64-b7ffb8be74d5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:44.993348 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2401b34c-f42b-4b26-af64-b7ffb8be74d5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:45.233929 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2401b34c-f42b-4b26-af64-b7ffb8be74d5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:45.234734 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-afc79e29-236f-4067-aff1-23d70b0eb4e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:45.254042 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-afc79e29-236f-4067-aff1-23d70b0eb4e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:45.255487 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2401b34c-f42b-4b26-af64-b7ffb8be74d5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.280761 May 25 15:40:45.256855 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 62/123] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:44 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:45.258275 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-afc79e29-236f-4067-aff1-23d70b0eb4e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:45.260017 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-afc79e29-236f-4067-aff1-23d70b0eb4e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1408 microversion: 2.20 time: 0.309011 May 25 15:40:45.260720 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 62/124] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:44 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1408 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:45.527363 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-11a9df65-f9f3-4528-826e-36317f3f22b3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:45.528371 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-11a9df65-f9f3-4528-826e-36317f3f22b3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:45.537102 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-11a9df65-f9f3-4528-826e-36317f3f22b3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:45.537569 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-11a9df65-f9f3-4528-826e-36317f3f22b3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:45.538577 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-11a9df65-f9f3-4528-826e-36317f3f22b3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:45.539855 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-11a9df65-f9f3-4528-826e-36317f3f22b3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:46.016641 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-11a9df65-f9f3-4528-826e-36317f3f22b3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:46.025452 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-11a9df65-f9f3-4528-826e-36317f3f22b3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.502656 May 25 15:40:46.026031 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 63/125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:45 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:46.273215 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e2e41c1d-88e3-4592-943f-311b1745a3f5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:46.273784 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e2e41c1d-88e3-4592-943f-311b1745a3f5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:46.281382 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e2e41c1d-88e3-4592-943f-311b1745a3f5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:46.281834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e2e41c1d-88e3-4592-943f-311b1745a3f5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:46.282611 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e2e41c1d-88e3-4592-943f-311b1745a3f5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:46.283056 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e2e41c1d-88e3-4592-943f-311b1745a3f5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:46.283879 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1c4690fa-0276-4d0b-9569-fbb84147c513 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:46.284802 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1c4690fa-0276-4d0b-9569-fbb84147c513 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:46.292193 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1c4690fa-0276-4d0b-9569-fbb84147c513 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:46.292674 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1c4690fa-0276-4d0b-9569-fbb84147c513 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:46.293564 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1c4690fa-0276-4d0b-9569-fbb84147c513 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:46.294202 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1c4690fa-0276-4d0b-9569-fbb84147c513 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:46.495125 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e2e41c1d-88e3-4592-943f-311b1745a3f5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:46.506975 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e2e41c1d-88e3-4592-943f-311b1745a3f5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.237168 May 25 15:40:46.511893 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 63/126] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:46 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:46.558775 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1c4690fa-0276-4d0b-9569-fbb84147c513 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:46.570130 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1c4690fa-0276-4d0b-9569-fbb84147c513 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:46.571832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1c4690fa-0276-4d0b-9569-fbb84147c513 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:46.573134 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1c4690fa-0276-4d0b-9569-fbb84147c513 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1408 microversion: 2.20 time: 0.293265 May 25 15:40:46.573814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 64/127] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:46 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:40:47.043811 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-55fec168-5c48-4bf0-9f6f-3f2ec1a2d963 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:47.044838 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-55fec168-5c48-4bf0-9f6f-3f2ec1a2d963 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:47.056297 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-55fec168-5c48-4bf0-9f6f-3f2ec1a2d963 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:47.057179 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-55fec168-5c48-4bf0-9f6f-3f2ec1a2d963 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:47.058200 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-55fec168-5c48-4bf0-9f6f-3f2ec1a2d963 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:47.058875 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-55fec168-5c48-4bf0-9f6f-3f2ec1a2d963 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:47.293951 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-55fec168-5c48-4bf0-9f6f-3f2ec1a2d963 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:47.305264 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-55fec168-5c48-4bf0-9f6f-3f2ec1a2d963 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.266290 May 25 15:40:47.306317 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 64/128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:47 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:47.524955 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5a94664a-21a7-49ec-bbe3-f32d6e7ea055 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:47.525641 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5a94664a-21a7-49ec-bbe3-f32d6e7ea055 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:47.535624 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5a94664a-21a7-49ec-bbe3-f32d6e7ea055 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:47.536125 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5a94664a-21a7-49ec-bbe3-f32d6e7ea055 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:47.536974 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5a94664a-21a7-49ec-bbe3-f32d6e7ea055 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:47.537373 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5a94664a-21a7-49ec-bbe3-f32d6e7ea055 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:47.595646 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-551b3b00-c087-479c-b7fd-b690c3736f66 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:47.596620 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-551b3b00-c087-479c-b7fd-b690c3736f66 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:47.605165 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-551b3b00-c087-479c-b7fd-b690c3736f66 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:47.606084 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-551b3b00-c087-479c-b7fd-b690c3736f66 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:47.607098 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-551b3b00-c087-479c-b7fd-b690c3736f66 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:47.607728 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-551b3b00-c087-479c-b7fd-b690c3736f66 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:47.850803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-551b3b00-c087-479c-b7fd-b690c3736f66 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:47.862667 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-551b3b00-c087-479c-b7fd-b690c3736f66 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:47.864666 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-551b3b00-c087-479c-b7fd-b690c3736f66 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:47.866335 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-551b3b00-c087-479c-b7fd-b690c3736f66 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1408 microversion: 2.20 time: 0.278802 May 25 15:40:47.868562 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 65/129] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:47 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:40:48.153267 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5a94664a-21a7-49ec-bbe3-f32d6e7ea055 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:48.167849 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5a94664a-21a7-49ec-bbe3-f32d6e7ea055 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.646659 May 25 15:40:48.178285 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 65/130] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:47 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:48.323167 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9b42d1be-10b9-4d5a-af85-a5d48b95b952 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:48.323803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9b42d1be-10b9-4d5a-af85-a5d48b95b952 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:48.340289 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b42d1be-10b9-4d5a-af85-a5d48b95b952 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:48.340761 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b42d1be-10b9-4d5a-af85-a5d48b95b952 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:48.348238 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b42d1be-10b9-4d5a-af85-a5d48b95b952 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:48.349981 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b42d1be-10b9-4d5a-af85-a5d48b95b952 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:48.727642 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9b42d1be-10b9-4d5a-af85-a5d48b95b952 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:48.742850 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9b42d1be-10b9-4d5a-af85-a5d48b95b952 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.422311 May 25 15:40:48.745436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 66/131] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:48 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:48.892356 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3a0dce8c-7c34-4dd9-bfee-3326597989ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:48.898216 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-3a0dce8c-7c34-4dd9-bfee-3326597989ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:48.924872 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3a0dce8c-7c34-4dd9-bfee-3326597989ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:48.925355 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3a0dce8c-7c34-4dd9-bfee-3326597989ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:48.926167 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3a0dce8c-7c34-4dd9-bfee-3326597989ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:48.926620 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3a0dce8c-7c34-4dd9-bfee-3326597989ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:49.188960 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7f6d77ed-5e10-4d3a-933c-8945e9aae3a1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:49.189754 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7f6d77ed-5e10-4d3a-933c-8945e9aae3a1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:49.207267 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7f6d77ed-5e10-4d3a-933c-8945e9aae3a1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:49.209204 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7f6d77ed-5e10-4d3a-933c-8945e9aae3a1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:49.210260 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7f6d77ed-5e10-4d3a-933c-8945e9aae3a1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:49.214789 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7f6d77ed-5e10-4d3a-933c-8945e9aae3a1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:49.657822 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7f6d77ed-5e10-4d3a-933c-8945e9aae3a1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:49.677126 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7f6d77ed-5e10-4d3a-933c-8945e9aae3a1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.495733 May 25 15:40:49.677790 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 67/132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:49 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:49.690802 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-b25fc081-3768-4071-86bb-c33d22e300f1 req-9dd274e5-0c27-4a2a-8ae1-e4afabdd8577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a5442b-0f3d-41d4-b44f-74e483852fda", "name": "network-vif-plugged", "status": "completed", "tag": "58598550-b0ed-4b7c-a4d8-2e58f345261c"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:49.692815 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:40:49.692815 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:40:49.712859 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-b25fc081-3768-4071-86bb-c33d22e300f1 req-9dd274e5-0c27-4a2a-8ae1-e4afabdd8577 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:49.713592 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-b25fc081-3768-4071-86bb-c33d22e300f1 req-9dd274e5-0c27-4a2a-8ae1-e4afabdd8577 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:49.733420 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-b25fc081-3768-4071-86bb-c33d22e300f1 req-9dd274e5-0c27-4a2a-8ae1-e4afabdd8577 service nova] Creating event network-vif-plugged:58598550-b0ed-4b7c-a4d8-2e58f345261c for instance 80a5442b-0f3d-41d4-b44f-74e483852fda on hv-cinder-79123 May 25 15:40:49.739507 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-b25fc081-3768-4071-86bb-c33d22e300f1 req-9dd274e5-0c27-4a2a-8ae1-e4afabdd8577 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053695 May 25 15:40:49.740841 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 68/133] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:40:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:40:49.773208 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fbfec00c-fced-4a4a-84a9-70dca4f7b65d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:49.776685 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fbfec00c-fced-4a4a-84a9-70dca4f7b65d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:49.791456 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fbfec00c-fced-4a4a-84a9-70dca4f7b65d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:49.792018 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fbfec00c-fced-4a4a-84a9-70dca4f7b65d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:49.793084 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fbfec00c-fced-4a4a-84a9-70dca4f7b65d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:49.793921 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fbfec00c-fced-4a4a-84a9-70dca4f7b65d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:49.852321 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3a0dce8c-7c34-4dd9-bfee-3326597989ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:49.863328 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3a0dce8c-7c34-4dd9-bfee-3326597989ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:49.869764 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3a0dce8c-7c34-4dd9-bfee-3326597989ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:49.873152 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3a0dce8c-7c34-4dd9-bfee-3326597989ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1408 microversion: 2.20 time: 0.991742 May 25 15:40:49.873691 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 66/134] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:48 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1408 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:50.177895 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-fbfec00c-fced-4a4a-84a9-70dca4f7b65d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:50.191089 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fbfec00c-fced-4a4a-84a9-70dca4f7b65d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.427863 May 25 15:40:50.191976 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 69/135] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:49 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:50.693623 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-60e26605-696a-4a3c-aa55-91c5edf35484 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:50.694931 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-60e26605-696a-4a3c-aa55-91c5edf35484 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:50.703102 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-60e26605-696a-4a3c-aa55-91c5edf35484 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:50.703849 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-60e26605-696a-4a3c-aa55-91c5edf35484 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:50.705104 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-60e26605-696a-4a3c-aa55-91c5edf35484 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:50.706553 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-60e26605-696a-4a3c-aa55-91c5edf35484 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:50.891562 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:50.892958 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:50.913226 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:50.917434 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:50.918991 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:50.919659 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:51.098339 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-60e26605-696a-4a3c-aa55-91c5edf35484 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:51.108211 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-60e26605-696a-4a3c-aa55-91c5edf35484 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1322 microversion: 2.1 time: 0.418275 May 25 15:40:51.109469 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 67/136] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:50 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:51.226959 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e6f3d31c-e45c-4cc2-a47d-88bcf6b60129 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:51.227949 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e6f3d31c-e45c-4cc2-a47d-88bcf6b60129 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:51.246398 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e6f3d31c-e45c-4cc2-a47d-88bcf6b60129 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:51.246884 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e6f3d31c-e45c-4cc2-a47d-88bcf6b60129 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:51.248232 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e6f3d31c-e45c-4cc2-a47d-88bcf6b60129 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:51.248678 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e6f3d31c-e45c-4cc2-a47d-88bcf6b60129 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:51.832516 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-e6f3d31c-e45c-4cc2-a47d-88bcf6b60129 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:51.847653 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e6f3d31c-e45c-4cc2-a47d-88bcf6b60129 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.642765 May 25 15:40:51.848285 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 68/137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:51 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:51.904050 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-250b8122-0cb3-48d8-b645-4bf18bb607f5 req-03a7a04e-8427-4b6c-a503-f99f85665b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b62e88c-87e4-4020-9fc4-9b2cffdc55de", "name": "network-vif-plugged", "status": "completed", "tag": "62bd6a93-b70f-4e83-a70a-9b823ecbd7dc"}, {"server_uuid": "92aed9d5-56b6-4cbf-9678-b16f7de68b23", "name": "network-vif-plugged", "status": "completed", "tag": "cfbb7459-c8f7-4441-8886-be2a6b4ad1a7"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:51.906740 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:40:51.906740 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:40:51.922481 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-250b8122-0cb3-48d8-b645-4bf18bb607f5 req-03a7a04e-8427-4b6c-a503-f99f85665b7d service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:51.922934 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-250b8122-0cb3-48d8-b645-4bf18bb607f5 req-03a7a04e-8427-4b6c-a503-f99f85665b7d service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:51.938839 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:51.954250 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:51.960674 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:51.961042 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-250b8122-0cb3-48d8-b645-4bf18bb607f5 req-03a7a04e-8427-4b6c-a503-f99f85665b7d service nova] Creating event network-vif-plugged:62bd6a93-b70f-4e83-a70a-9b823ecbd7dc for instance 1b62e88c-87e4-4020-9fc4-9b2cffdc55de on hv-cinder-79123 May 25 15:40:51.961990 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-250b8122-0cb3-48d8-b645-4bf18bb607f5 req-03a7a04e-8427-4b6c-a503-f99f85665b7d service nova] Creating event network-vif-plugged:cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 for instance 92aed9d5-56b6-4cbf-9678-b16f7de68b23 on hv-cinder-79123 May 25 15:40:51.963631 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1408 microversion: 2.20 time: 1.074356 May 25 15:40:51.965483 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 70/138] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:50 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1408 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:40:51.970704 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-250b8122-0cb3-48d8-b645-4bf18bb607f5 req-03a7a04e-8427-4b6c-a503-f99f85665b7d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070797 May 25 15:40:51.975297 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 69/139] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:40:51 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:40:52.124519 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7ff5681d-5220-4311-887d-7678bcb2ac0a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:52.125157 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7ff5681d-5220-4311-887d-7678bcb2ac0a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:52.149857 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7ff5681d-5220-4311-887d-7678bcb2ac0a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:52.150695 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7ff5681d-5220-4311-887d-7678bcb2ac0a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:52.151708 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7ff5681d-5220-4311-887d-7678bcb2ac0a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:52.155112 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7ff5681d-5220-4311-887d-7678bcb2ac0a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:52.865205 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c277868a-91b6-40a5-8d1c-316b5c38056b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:52.866599 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c277868a-91b6-40a5-8d1c-316b5c38056b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:52.890135 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c277868a-91b6-40a5-8d1c-316b5c38056b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:52.890683 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c277868a-91b6-40a5-8d1c-316b5c38056b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:52.891380 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c277868a-91b6-40a5-8d1c-316b5c38056b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:52.893838 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c277868a-91b6-40a5-8d1c-316b5c38056b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:53.164011 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7ff5681d-5220-4311-887d-7678bcb2ac0a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:53.178718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7ff5681d-5220-4311-887d-7678bcb2ac0a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1517 microversion: 2.1 time: 1.056629 May 25 15:40:53.201308 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 71/140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:52 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1517 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:53.206740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b8be0f14-9d34-4831-bd97-6e7736ed1943 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:53.207377 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b8be0f14-9d34-4831-bd97-6e7736ed1943 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:53.249471 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b8be0f14-9d34-4831-bd97-6e7736ed1943 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:53.249946 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b8be0f14-9d34-4831-bd97-6e7736ed1943 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:53.258326 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b8be0f14-9d34-4831-bd97-6e7736ed1943 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:53.259976 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b8be0f14-9d34-4831-bd97-6e7736ed1943 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:53.406336 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c277868a-91b6-40a5-8d1c-316b5c38056b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:53.421608 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c277868a-91b6-40a5-8d1c-316b5c38056b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 0.561034 May 25 15:40:53.422658 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 70/141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:52 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:53.438416 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bdc9454a-c058-4765-af23-b2cfb2f737c9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:53.440719 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bdc9454a-c058-4765-af23-b2cfb2f737c9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:53.453593 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bdc9454a-c058-4765-af23-b2cfb2f737c9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:53.454584 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bdc9454a-c058-4765-af23-b2cfb2f737c9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:53.456486 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bdc9454a-c058-4765-af23-b2cfb2f737c9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:53.457108 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bdc9454a-c058-4765-af23-b2cfb2f737c9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:53.546788 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-bdc9454a-c058-4765-af23-b2cfb2f737c9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lazy-loading 'flavor' on Instance uuid 80a5442b-0f3d-41d4-b44f-74e483852fda {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:40:53.895361 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bdc9454a-c058-4765-af23-b2cfb2f737c9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "POST /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda/action" status: 200 len: 32 microversion: 2.1 time: 0.470616 May 25 15:40:53.897812 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 71/142] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:40:53 2021] POST /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda/action => generated 32 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:40:53.912541 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a607999b-6f11-4416-a027-e05a9811da9a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:53.913290 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a607999b-6f11-4416-a027-e05a9811da9a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:53.938806 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a607999b-6f11-4416-a027-e05a9811da9a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:53.941068 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a607999b-6f11-4416-a027-e05a9811da9a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:53.942765 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a607999b-6f11-4416-a027-e05a9811da9a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:53.943780 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a607999b-6f11-4416-a027-e05a9811da9a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:54.106568 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b8be0f14-9d34-4831-bd97-6e7736ed1943 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:54.118567 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b8be0f14-9d34-4831-bd97-6e7736ed1943 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:54.123487 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b8be0f14-9d34-4831-bd97-6e7736ed1943 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:54.126202 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b8be0f14-9d34-4831-bd97-6e7736ed1943 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1408 microversion: 2.20 time: 0.923820 May 25 15:40:54.132616 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 72/143] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:53 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1408 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:54.137718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-ec5ec710-87f9-4ebc-ae54-048baeb06c4a req-3c2e2db1-c57b-494f-afb0-9fbea1162ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9301f1db-ecb0-465b-858c-64a2bfd4d5cb", "name": "network-vif-plugged", "status": "completed", "tag": "3f734a1c-be04-4203-b351-6b0b6785f9ae"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:40:54.147677 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:40:54.147677 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:40:54.162618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-ec5ec710-87f9-4ebc-ae54-048baeb06c4a req-3c2e2db1-c57b-494f-afb0-9fbea1162ff2 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:54.163511 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-ec5ec710-87f9-4ebc-ae54-048baeb06c4a req-3c2e2db1-c57b-494f-afb0-9fbea1162ff2 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:54.198617 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-ec5ec710-87f9-4ebc-ae54-048baeb06c4a req-3c2e2db1-c57b-494f-afb0-9fbea1162ff2 service nova] Creating event network-vif-plugged:3f734a1c-be04-4203-b351-6b0b6785f9ae for instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb on hv-cinder-79123 May 25 15:40:54.209804 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-ec5ec710-87f9-4ebc-ae54-048baeb06c4a req-3c2e2db1-c57b-494f-afb0-9fbea1162ff2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075648 May 25 15:40:54.222470 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 73/144] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:40:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:40:54.428164 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a607999b-6f11-4416-a027-e05a9811da9a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:54.437949 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a607999b-6f11-4416-a027-e05a9811da9a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.534973 May 25 15:40:54.441894 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 72/145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:53 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:54.445464 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e1b6e6b4-903f-4ea1-a2cc-7ecbcf50c518 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:54.446475 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e1b6e6b4-903f-4ea1-a2cc-7ecbcf50c518 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:54.458095 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1b6e6b4-903f-4ea1-a2cc-7ecbcf50c518 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:54.458561 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1b6e6b4-903f-4ea1-a2cc-7ecbcf50c518 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:54.459347 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1b6e6b4-903f-4ea1-a2cc-7ecbcf50c518 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:54.459788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1b6e6b4-903f-4ea1-a2cc-7ecbcf50c518 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:55.149942 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7ff2730e-8790-4d76-9fd8-027cbb90a564 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:55.151264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7ff2730e-8790-4d76-9fd8-027cbb90a564 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:55.161129 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7ff2730e-8790-4d76-9fd8-027cbb90a564 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:55.161485 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7ff2730e-8790-4d76-9fd8-027cbb90a564 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:55.165482 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7ff2730e-8790-4d76-9fd8-027cbb90a564 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:55.168226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7ff2730e-8790-4d76-9fd8-027cbb90a564 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:55.454344 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e1b6e6b4-903f-4ea1-a2cc-7ecbcf50c518 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:55.468247 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e1b6e6b4-903f-4ea1-a2cc-7ecbcf50c518 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1361 microversion: 2.1 time: 1.032317 May 25 15:40:55.470421 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 74/146] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:54 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1361 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:55.493665 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7940017d-4586-4d5e-a2ec-563f4fd62d19 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:55.494335 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7940017d-4586-4d5e-a2ec-563f4fd62d19 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:55.514273 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7940017d-4586-4d5e-a2ec-563f4fd62d19 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:55.514740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7940017d-4586-4d5e-a2ec-563f4fd62d19 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:55.515538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7940017d-4586-4d5e-a2ec-563f4fd62d19 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:55.516518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7940017d-4586-4d5e-a2ec-563f4fd62d19 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:55.922925 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7ff2730e-8790-4d76-9fd8-027cbb90a564 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:55.932947 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7ff2730e-8790-4d76-9fd8-027cbb90a564 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:55.935121 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7ff2730e-8790-4d76-9fd8-027cbb90a564 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:55.935522 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7ff2730e-8790-4d76-9fd8-027cbb90a564 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1408 microversion: 2.20 time: 0.789276 May 25 15:40:55.936744 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 73/147] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:55 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1408 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:56.487670 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c0c2cf5b-ee7c-4612-a87b-8a41f49633a1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:56.488749 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c0c2cf5b-ee7c-4612-a87b-8a41f49633a1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:56.511275 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c0c2cf5b-ee7c-4612-a87b-8a41f49633a1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:56.512036 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c0c2cf5b-ee7c-4612-a87b-8a41f49633a1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:56.512852 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c0c2cf5b-ee7c-4612-a87b-8a41f49633a1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:56.513308 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c0c2cf5b-ee7c-4612-a87b-8a41f49633a1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:56.774360 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7940017d-4586-4d5e-a2ec-563f4fd62d19 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:56.780800 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c0c2cf5b-ee7c-4612-a87b-8a41f49633a1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:56.788941 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7940017d-4586-4d5e-a2ec-563f4fd62d19 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 1.317222 May 25 15:40:56.793368 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c0c2cf5b-ee7c-4612-a87b-8a41f49633a1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1547 microversion: 2.1 time: 0.309922 May 25 15:40:56.794289 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 75/148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:55 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:56.794665 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 74/149] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:56 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1547 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:56.811550 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-17a7b083-72d8-4b6e-9643-72e6b8f69a80 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:56.812099 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-17a7b083-72d8-4b6e-9643-72e6b8f69a80 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:56.823688 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-17a7b083-72d8-4b6e-9643-72e6b8f69a80 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:56.824268 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-17a7b083-72d8-4b6e-9643-72e6b8f69a80 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:56.825175 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-17a7b083-72d8-4b6e-9643-72e6b8f69a80 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:56.825697 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-17a7b083-72d8-4b6e-9643-72e6b8f69a80 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:56.829218 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e9c04d21-3563-4a3e-941e-673b60769bc5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:56.829904 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e9c04d21-3563-4a3e-941e-673b60769bc5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:56.838487 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e9c04d21-3563-4a3e-941e-673b60769bc5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:56.839098 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e9c04d21-3563-4a3e-941e-673b60769bc5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:56.840075 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e9c04d21-3563-4a3e-941e-673b60769bc5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:56.840660 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e9c04d21-3563-4a3e-941e-673b60769bc5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:56.913718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e9c04d21-3563-4a3e-941e-673b60769bc5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Going to try to terminate instance {{(pid=112577) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:40:57.018126 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-17a7b083-72d8-4b6e-9643-72e6b8f69a80 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211068 May 25 15:40:57.018988 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 75/150] 10.222.0.36 () {58 vars in 1275 bytes} [Tue May 25 15:40:56 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:40:57.025339 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-55aa8236-d9f5-4129-a2b5-466039ab9c57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:57.026308 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-55aa8236-d9f5-4129-a2b5-466039ab9c57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:57.045623 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-55aa8236-d9f5-4129-a2b5-466039ab9c57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:57.061478 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e9c04d21-3563-4a3e-941e-673b60769bc5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "DELETE /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 204 len: 0 microversion: 2.1 time: 0.246393 May 25 15:40:57.063139 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 76/151] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:40:56 2021] DELETE /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:40:57.064502 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-55aa8236-d9f5-4129-a2b5-466039ab9c57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:57.068266 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-55aa8236-d9f5-4129-a2b5-466039ab9c57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:57.068789 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-55aa8236-d9f5-4129-a2b5-466039ab9c57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:57.072439 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-40baa53e-e524-436b-a2c6-cb4338fe0999 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:57.073555 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-40baa53e-e524-436b-a2c6-cb4338fe0999 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:57.082056 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-40baa53e-e524-436b-a2c6-cb4338fe0999 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:57.083711 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-40baa53e-e524-436b-a2c6-cb4338fe0999 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:57.085519 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-40baa53e-e524-436b-a2c6-cb4338fe0999 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:57.087567 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-40baa53e-e524-436b-a2c6-cb4338fe0999 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:57.654778 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-40baa53e-e524-436b-a2c6-cb4338fe0999 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:57.669448 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-40baa53e-e524-436b-a2c6-cb4338fe0999 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1554 microversion: 2.1 time: 0.601748 May 25 15:40:57.670383 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 77/152] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:57 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1554 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:40:57.818494 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f2ff7d0c-9c24-448a-9b12-1e2f9c33518f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:57.819143 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f2ff7d0c-9c24-448a-9b12-1e2f9c33518f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:57.828403 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f2ff7d0c-9c24-448a-9b12-1e2f9c33518f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:57.828875 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f2ff7d0c-9c24-448a-9b12-1e2f9c33518f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:57.829680 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f2ff7d0c-9c24-448a-9b12-1e2f9c33518f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:57.830126 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f2ff7d0c-9c24-448a-9b12-1e2f9c33518f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:58.182851 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f2ff7d0c-9c24-448a-9b12-1e2f9c33518f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:58.196312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f2ff7d0c-9c24-448a-9b12-1e2f9c33518f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.387515 May 25 15:40:58.197833 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 78/153] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:57 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:58.450106 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-55aa8236-d9f5-4129-a2b5-466039ab9c57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:58.461377 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-55aa8236-d9f5-4129-a2b5-466039ab9c57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:58.470210 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-55aa8236-d9f5-4129-a2b5-466039ab9c57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:58.475355 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-55aa8236-d9f5-4129-a2b5-466039ab9c57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1408 microversion: 2.20 time: 1.454943 May 25 15:40:58.476724 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 76/154] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:57 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1408 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:40:58.686798 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fb153c13-70e1-4031-bc7d-d0f5e070275a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:58.687447 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fb153c13-70e1-4031-bc7d-d0f5e070275a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:58.699318 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fb153c13-70e1-4031-bc7d-d0f5e070275a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:58.699788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fb153c13-70e1-4031-bc7d-d0f5e070275a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:58.700616 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fb153c13-70e1-4031-bc7d-d0f5e070275a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:58.701062 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fb153c13-70e1-4031-bc7d-d0f5e070275a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:59.214867 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f6ca9a2e-f200-49b0-bdcb-7b56c04a0ecd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:59.215610 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f6ca9a2e-f200-49b0-bdcb-7b56c04a0ecd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:59.235473 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f6ca9a2e-f200-49b0-bdcb-7b56c04a0ecd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:59.236132 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f6ca9a2e-f200-49b0-bdcb-7b56c04a0ecd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:59.237781 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f6ca9a2e-f200-49b0-bdcb-7b56c04a0ecd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:59.238477 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f6ca9a2e-f200-49b0-bdcb-7b56c04a0ecd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:59.380780 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-fb153c13-70e1-4031-bc7d-d0f5e070275a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:59.423172 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fb153c13-70e1-4031-bc7d-d0f5e070275a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1554 microversion: 2.1 time: 0.740062 May 25 15:40:59.424941 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 79/155] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:58 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1554 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:40:59.498507 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-00451b12-d5ef-46da-9789-b8597ef26302 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:40:59.499638 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-00451b12-d5ef-46da-9789-b8597ef26302 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:40:59.513330 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-00451b12-d5ef-46da-9789-b8597ef26302 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:59.514497 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-00451b12-d5ef-46da-9789-b8597ef26302 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:59.514801 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-00451b12-d5ef-46da-9789-b8597ef26302 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:59.515327 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-00451b12-d5ef-46da-9789-b8597ef26302 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:59.764530 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f6ca9a2e-f200-49b0-bdcb-7b56c04a0ecd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:40:59.776501 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f6ca9a2e-f200-49b0-bdcb-7b56c04a0ecd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.565912 May 25 15:40:59.777863 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 77/156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:40:59 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:00.028946 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d533ede5-9cab-4449-808c-768a7f858c63 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:00.030273 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d533ede5-9cab-4449-808c-768a7f858c63 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:00.048926 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d533ede5-9cab-4449-808c-768a7f858c63 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:00.050209 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d533ede5-9cab-4449-808c-768a7f858c63 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:00.051167 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d533ede5-9cab-4449-808c-768a7f858c63 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:00.056564 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d533ede5-9cab-4449-808c-768a7f858c63 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:00.179182 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-00451b12-d5ef-46da-9789-b8597ef26302 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:00.193534 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-00451b12-d5ef-46da-9789-b8597ef26302 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:00.195514 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-00451b12-d5ef-46da-9789-b8597ef26302 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:00.196886 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-00451b12-d5ef-46da-9789-b8597ef26302 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1600 microversion: 2.20 time: 0.705911 May 25 15:41:00.215327 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 80/157] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:40:59 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1600 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:41:00.240608 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-95c75a63-03cf-4afa-bf28-46c697b4b6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92aed9d5-56b6-4cbf-9678-b16f7de68b23", "tag": "cfbb7459-c8f7-4441-8886-be2a6b4ad1a7"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:00.244812 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:41:00.244812 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:41:00.269771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-95c75a63-03cf-4afa-bf28-46c697b4b6bf service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:00.270425 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-95c75a63-03cf-4afa-bf28-46c697b4b6bf service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:00.306216 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-95c75a63-03cf-4afa-bf28-46c697b4b6bf service nova] Creating event network-changed:cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 for instance 92aed9d5-56b6-4cbf-9678-b16f7de68b23 on hv-cinder-79123 May 25 15:41:00.318413 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-95c75a63-03cf-4afa-bf28-46c697b4b6bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101218 May 25 15:41:00.322401 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 81/158] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:41:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:41:00.329836 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6c6408e6-87fb-4fb8-88bb-a58953c89462 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:00.332369 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6c6408e6-87fb-4fb8-88bb-a58953c89462 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:00.350572 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c6408e6-87fb-4fb8-88bb-a58953c89462 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:00.352040 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c6408e6-87fb-4fb8-88bb-a58953c89462 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:00.353393 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c6408e6-87fb-4fb8-88bb-a58953c89462 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:00.353847 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c6408e6-87fb-4fb8-88bb-a58953c89462 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:00.663515 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6c6408e6-87fb-4fb8-88bb-a58953c89462 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.339634 May 25 15:41:00.664530 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 82/159] 10.222.0.36 () {60 vars in 1316 bytes} [Tue May 25 15:41:00 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/os-interface => generated 285 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:41:00.674758 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-98c55384-db82-4f21-aff4-eecf11d9e9ca tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:00.675409 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-98c55384-db82-4f21-aff4-eecf11d9e9ca tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:00.688439 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-98c55384-db82-4f21-aff4-eecf11d9e9ca tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:00.692815 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-98c55384-db82-4f21-aff4-eecf11d9e9ca tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:00.693717 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-98c55384-db82-4f21-aff4-eecf11d9e9ca tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:00.694186 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-98c55384-db82-4f21-aff4-eecf11d9e9ca tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:01.923414 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-98c55384-db82-4f21-aff4-eecf11d9e9ca tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:01.942703 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-98c55384-db82-4f21-aff4-eecf11d9e9ca tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1554 microversion: 2.1 time: 1.277020 May 25 15:41:01.956304 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 83/160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:00 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1554 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:01.968194 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-baad2a0a-f4f0-4876-a96e-911b5a457887 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:01.968892 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-baad2a0a-f4f0-4876-a96e-911b5a457887 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:01.985923 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-baad2a0a-f4f0-4876-a96e-911b5a457887 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:01.986394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-baad2a0a-f4f0-4876-a96e-911b5a457887 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:01.987261 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-baad2a0a-f4f0-4876-a96e-911b5a457887 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:01.987699 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-baad2a0a-f4f0-4876-a96e-911b5a457887 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:02.816751 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-baad2a0a-f4f0-4876-a96e-911b5a457887 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:02.825314 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-baad2a0a-f4f0-4876-a96e-911b5a457887 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.867769 May 25 15:41:02.828861 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 84/161] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:01 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:02.960017 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2d7e2957-4015-4bbf-b2ed-b406d51b9b7a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:02.961353 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2d7e2957-4015-4bbf-b2ed-b406d51b9b7a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:02.971991 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2d7e2957-4015-4bbf-b2ed-b406d51b9b7a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:02.972682 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2d7e2957-4015-4bbf-b2ed-b406d51b9b7a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:02.973621 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2d7e2957-4015-4bbf-b2ed-b406d51b9b7a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:02.974204 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2d7e2957-4015-4bbf-b2ed-b406d51b9b7a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:03.481442 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d533ede5-9cab-4449-808c-768a7f858c63 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 3.460440 May 25 15:41:03.482554 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 78/162] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:00 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 3462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:03.763713 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2d7e2957-4015-4bbf-b2ed-b406d51b9b7a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:03.773734 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2d7e2957-4015-4bbf-b2ed-b406d51b9b7a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1554 microversion: 2.1 time: 0.817394 May 25 15:41:03.774436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 85/163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:02 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1554 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:03.846573 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4df6e916-72ec-4a94-af8f-c6d819533d4c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:03.847279 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4df6e916-72ec-4a94-af8f-c6d819533d4c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:03.861121 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4df6e916-72ec-4a94-af8f-c6d819533d4c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:03.862439 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4df6e916-72ec-4a94-af8f-c6d819533d4c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:03.863621 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4df6e916-72ec-4a94-af8f-c6d819533d4c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:03.864340 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4df6e916-72ec-4a94-af8f-c6d819533d4c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:04.195751 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4df6e916-72ec-4a94-af8f-c6d819533d4c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:04.209149 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4df6e916-72ec-4a94-af8f-c6d819533d4c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.367676 May 25 15:41:04.209731 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 79/164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:03 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:04.494591 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dcfa74da-705a-4b06-97c2-f115a9d9c2a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:04.495691 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-dcfa74da-705a-4b06-97c2-f115a9d9c2a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:04.520443 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dcfa74da-705a-4b06-97c2-f115a9d9c2a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:04.520973 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dcfa74da-705a-4b06-97c2-f115a9d9c2a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:04.522120 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dcfa74da-705a-4b06-97c2-f115a9d9c2a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:04.522847 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dcfa74da-705a-4b06-97c2-f115a9d9c2a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:04.791774 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-469fdb2c-ec6c-4dfb-a871-50a3c5da4b61 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:04.793216 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-469fdb2c-ec6c-4dfb-a871-50a3c5da4b61 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:04.802120 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dcfa74da-705a-4b06-97c2-f115a9d9c2a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.312262 May 25 15:41:04.803288 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 86/165] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:04 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:04.824340 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-469fdb2c-ec6c-4dfb-a871-50a3c5da4b61 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:04.825866 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-469fdb2c-ec6c-4dfb-a871-50a3c5da4b61 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:04.827322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-469fdb2c-ec6c-4dfb-a871-50a3c5da4b61 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:04.829106 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-469fdb2c-ec6c-4dfb-a871-50a3c5da4b61 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:04.869765 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-120fa476-b32c-4221-82ff-2d275933617c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:04.872340 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-120fa476-b32c-4221-82ff-2d275933617c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:04.924557 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-120fa476-b32c-4221-82ff-2d275933617c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:04.925391 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-120fa476-b32c-4221-82ff-2d275933617c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:04.926332 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-120fa476-b32c-4221-82ff-2d275933617c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:04.926793 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-120fa476-b32c-4221-82ff-2d275933617c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:05.217180 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-120fa476-b32c-4221-82ff-2d275933617c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.352244 May 25 15:41:05.218462 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 87/166] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:04 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:05.225624 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-9fd1e844-9c0d-4be1-8fc0-bfd567a7b5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9301f1db-ecb0-465b-858c-64a2bfd4d5cb", "tag": "3f734a1c-be04-4203-b351-6b0b6785f9ae"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:05.233205 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:41:05.233205 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:41:05.282376 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-9fd1e844-9c0d-4be1-8fc0-bfd567a7b5fe service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:05.282841 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-9fd1e844-9c0d-4be1-8fc0-bfd567a7b5fe service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:05.295332 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-469fdb2c-ec6c-4dfb-a871-50a3c5da4b61 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:05.309971 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-469fdb2c-ec6c-4dfb-a871-50a3c5da4b61 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1554 microversion: 2.1 time: 0.522848 May 25 15:41:05.318779 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 80/167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:04 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1554 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:41:05.331082 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f5d3f450-026b-4f7b-9d30-191e85fe188c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:05.332158 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f5d3f450-026b-4f7b-9d30-191e85fe188c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:05.346815 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-9fd1e844-9c0d-4be1-8fc0-bfd567a7b5fe service nova] Creating event network-changed:3f734a1c-be04-4203-b351-6b0b6785f9ae for instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb on hv-cinder-79123 May 25 15:41:05.347213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f5d3f450-026b-4f7b-9d30-191e85fe188c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:05.350248 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f5d3f450-026b-4f7b-9d30-191e85fe188c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:05.352621 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f5d3f450-026b-4f7b-9d30-191e85fe188c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:05.354049 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-9fd1e844-9c0d-4be1-8fc0-bfd567a7b5fe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134047 May 25 15:41:05.354822 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f5d3f450-026b-4f7b-9d30-191e85fe188c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:05.355336 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 88/168] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:41:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:41:05.822448 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1cded6a1-a301-45c0-81b0-d83220de00af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:05.825929 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1cded6a1-a301-45c0-81b0-d83220de00af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:05.851437 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1cded6a1-a301-45c0-81b0-d83220de00af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:05.855773 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1cded6a1-a301-45c0-81b0-d83220de00af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:05.856917 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1cded6a1-a301-45c0-81b0-d83220de00af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:05.862903 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1cded6a1-a301-45c0-81b0-d83220de00af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:06.094262 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1cded6a1-a301-45c0-81b0-d83220de00af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.274198 May 25 15:41:06.097622 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 89/169] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:05 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 15:41:06.230239 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a091bf40-d769-4481-b071-380df51dcd13 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:06.231641 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a091bf40-d769-4481-b071-380df51dcd13 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:06.260785 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a091bf40-d769-4481-b071-380df51dcd13 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:06.261267 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a091bf40-d769-4481-b071-380df51dcd13 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:06.266575 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a091bf40-d769-4481-b071-380df51dcd13 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:06.267078 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a091bf40-d769-4481-b071-380df51dcd13 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:06.427066 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f5d3f450-026b-4f7b-9d30-191e85fe188c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:06.435722 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f5d3f450-026b-4f7b-9d30-191e85fe188c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 1.115443 May 25 15:41:06.436347 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 81/170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:05 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:06.441241 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2d6e105b-014d-4451-8d4a-c48c992faa7d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:06.441886 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2d6e105b-014d-4451-8d4a-c48c992faa7d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:06.455135 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2d6e105b-014d-4451-8d4a-c48c992faa7d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:06.455854 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a091bf40-d769-4481-b071-380df51dcd13 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.229794 May 25 15:41:06.456674 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 90/171] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:06 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:06.457118 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2d6e105b-014d-4451-8d4a-c48c992faa7d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:06.459360 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2d6e105b-014d-4451-8d4a-c48c992faa7d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:06.460124 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2d6e105b-014d-4451-8d4a-c48c992faa7d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:07.043703 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2d6e105b-014d-4451-8d4a-c48c992faa7d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:07.060935 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2d6e105b-014d-4451-8d4a-c48c992faa7d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1554 microversion: 2.1 time: 0.623083 May 25 15:41:07.061525 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 82/172] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:06 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1554 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:07.109240 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6c7e217e-dcf4-4226-99fb-bda00991cf32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:07.110882 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6c7e217e-dcf4-4226-99fb-bda00991cf32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:07.131667 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c7e217e-dcf4-4226-99fb-bda00991cf32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:07.132369 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c7e217e-dcf4-4226-99fb-bda00991cf32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:07.133187 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c7e217e-dcf4-4226-99fb-bda00991cf32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:07.133686 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c7e217e-dcf4-4226-99fb-bda00991cf32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:07.277660 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6c7e217e-dcf4-4226-99fb-bda00991cf32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.173241 May 25 15:41:07.278874 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 91/173] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:07 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:07.453471 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-be6b6856-69e2-4eac-b853-af757b8eb714 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:07.454298 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-be6b6856-69e2-4eac-b853-af757b8eb714 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:07.468068 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2f21f80e-4c91-4cc5-ad8e-df847a4ee6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:07.469232 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2f21f80e-4c91-4cc5-ad8e-df847a4ee6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:07.490131 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-be6b6856-69e2-4eac-b853-af757b8eb714 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:07.492227 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f21f80e-4c91-4cc5-ad8e-df847a4ee6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:07.493100 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-be6b6856-69e2-4eac-b853-af757b8eb714 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:07.494821 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f21f80e-4c91-4cc5-ad8e-df847a4ee6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:07.497229 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-be6b6856-69e2-4eac-b853-af757b8eb714 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:07.499894 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f21f80e-4c91-4cc5-ad8e-df847a4ee6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:07.500656 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-be6b6856-69e2-4eac-b853-af757b8eb714 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:07.506820 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f21f80e-4c91-4cc5-ad8e-df847a4ee6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:07.744958 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2f21f80e-4c91-4cc5-ad8e-df847a4ee6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.282012 May 25 15:41:07.745984 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 92/174] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:07 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:07.907242 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-be6b6856-69e2-4eac-b853-af757b8eb714 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:07.917949 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-be6b6856-69e2-4eac-b853-af757b8eb714 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.468940 May 25 15:41:07.929178 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 83/175] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:07 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:08.081711 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fa03c24a-f9d3-4285-ace7-eade532b3e48 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:08.082480 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fa03c24a-f9d3-4285-ace7-eade532b3e48 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:08.095482 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fa03c24a-f9d3-4285-ace7-eade532b3e48 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:08.097326 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fa03c24a-f9d3-4285-ace7-eade532b3e48 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:08.104469 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fa03c24a-f9d3-4285-ace7-eade532b3e48 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:08.105638 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fa03c24a-f9d3-4285-ace7-eade532b3e48 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:08.288996 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bf602693-c9ba-4229-8873-1e43ca4213b2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:08.289982 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bf602693-c9ba-4229-8873-1e43ca4213b2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:08.302230 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bf602693-c9ba-4229-8873-1e43ca4213b2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:08.302689 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bf602693-c9ba-4229-8873-1e43ca4213b2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:08.303492 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bf602693-c9ba-4229-8873-1e43ca4213b2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:08.303953 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bf602693-c9ba-4229-8873-1e43ca4213b2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:08.440516 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bf602693-c9ba-4229-8873-1e43ca4213b2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.147067 May 25 15:41:08.441200 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 84/176] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:08 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 15:41:08.727466 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-b626e462-c017-4140-aaab-494285daab10 req-14a2e035-fa8f-4b04-8f45-b3daa3e8ca2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76837e96-02fc-46e9-bf8e-a0c0e19c1c19", "name": "network-vif-deleted", "tag": "6f230de1-4bde-4abc-ac21-bfe2eddf6700"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:08.730226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:41:08.730226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:41:08.742393 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-b626e462-c017-4140-aaab-494285daab10 req-14a2e035-fa8f-4b04-8f45-b3daa3e8ca2e service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:08.743272 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-b626e462-c017-4140-aaab-494285daab10 req-14a2e035-fa8f-4b04-8f45-b3daa3e8ca2e service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:08.765329 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-b626e462-c017-4140-aaab-494285daab10 req-14a2e035-fa8f-4b04-8f45-b3daa3e8ca2e service nova] Creating event network-vif-deleted:6f230de1-4bde-4abc-ac21-bfe2eddf6700 for instance 76837e96-02fc-46e9-bf8e-a0c0e19c1c19 on hv-cinder-79123 May 25 15:41:08.771508 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-b626e462-c017-4140-aaab-494285daab10 req-14a2e035-fa8f-4b04-8f45-b3daa3e8ca2e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050691 May 25 15:41:08.772860 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 85/177] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:41:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:41:08.778634 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-081b78f7-929d-45c2-a536-f194baf5a371 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:08.779694 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-081b78f7-929d-45c2-a536-f194baf5a371 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:08.788946 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-081b78f7-929d-45c2-a536-f194baf5a371 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:08.790253 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-081b78f7-929d-45c2-a536-f194baf5a371 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:08.791804 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-081b78f7-929d-45c2-a536-f194baf5a371 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:08.792459 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-081b78f7-929d-45c2-a536-f194baf5a371 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:08.926374 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-fa03c24a-f9d3-4285-ace7-eade532b3e48 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:08.937815 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fa03c24a-f9d3-4285-ace7-eade532b3e48 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1554 microversion: 2.1 time: 0.862206 May 25 15:41:08.940970 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 93/178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:08 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1554 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:08.945608 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3cb9f65d-7318-41ce-a25a-9ffbf5d3c5c7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:08.950896 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3cb9f65d-7318-41ce-a25a-9ffbf5d3c5c7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:08.960203 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3cb9f65d-7318-41ce-a25a-9ffbf5d3c5c7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:08.960962 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3cb9f65d-7318-41ce-a25a-9ffbf5d3c5c7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:08.961947 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3cb9f65d-7318-41ce-a25a-9ffbf5d3c5c7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:08.962587 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3cb9f65d-7318-41ce-a25a-9ffbf5d3c5c7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:08.967017 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-081b78f7-929d-45c2-a536-f194baf5a371 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.192530 May 25 15:41:08.968302 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 86/179] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:08 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:09.452120 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-dac2a82b-0566-4597-a9b2-482f0314c97c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:09.453529 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-dac2a82b-0566-4597-a9b2-482f0314c97c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:09.464609 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dac2a82b-0566-4597-a9b2-482f0314c97c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:09.465072 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dac2a82b-0566-4597-a9b2-482f0314c97c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:09.465873 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dac2a82b-0566-4597-a9b2-482f0314c97c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:09.476823 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dac2a82b-0566-4597-a9b2-482f0314c97c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:09.708405 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3cb9f65d-7318-41ce-a25a-9ffbf5d3c5c7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:09.711743 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-dac2a82b-0566-4597-a9b2-482f0314c97c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.263235 May 25 15:41:09.716752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 87/180] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:09 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:09.722329 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3cb9f65d-7318-41ce-a25a-9ffbf5d3c5c7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.780057 May 25 15:41:09.724834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 94/181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:08 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:09.959135 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-751c9df9-6a89-427f-8c3a-8aa044edbee4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:09.959901 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-751c9df9-6a89-427f-8c3a-8aa044edbee4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:09.973687 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-751c9df9-6a89-427f-8c3a-8aa044edbee4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:09.977475 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-614b9117-392a-48c3-aadc-406257a90bd1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:09.978668 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-751c9df9-6a89-427f-8c3a-8aa044edbee4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:09.979335 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-614b9117-392a-48c3-aadc-406257a90bd1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:09.979525 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-751c9df9-6a89-427f-8c3a-8aa044edbee4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:09.980009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-751c9df9-6a89-427f-8c3a-8aa044edbee4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:09.996492 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-614b9117-392a-48c3-aadc-406257a90bd1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:09.997348 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-614b9117-392a-48c3-aadc-406257a90bd1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:09.998374 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-614b9117-392a-48c3-aadc-406257a90bd1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:09.999021 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-614b9117-392a-48c3-aadc-406257a90bd1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:10.145523 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-751c9df9-6a89-427f-8c3a-8aa044edbee4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:10.146120 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-751c9df9-6a89-427f-8c3a-8aa044edbee4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:10.147079 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-751c9df9-6a89-427f-8c3a-8aa044edbee4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lazy-loading 'fault' on Instance uuid 76837e96-02fc-46e9-bf8e-a0c0e19c1c19 {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:41:10.225010 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-614b9117-392a-48c3-aadc-406257a90bd1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.250658 May 25 15:41:10.226086 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 95/182] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:09 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:41:10.242490 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-751c9df9-6a89-427f-8c3a-8aa044edbee4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a274a14b0b40189f646c167534de0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:10.256580 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-751c9df9-6a89-427f-8c3a-8aa044edbee4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 200 len: 1350 microversion: 2.1 time: 0.302830 May 25 15:41:10.257459 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 88/183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:09 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 1350 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:10.725724 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-353b6bf6-48b9-499a-a081-f48453371504 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:10.726786 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-353b6bf6-48b9-499a-a081-f48453371504 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:10.738812 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2f4461fa-cddf-49a8-8898-d69429b9eea4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:10.739752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2f4461fa-cddf-49a8-8898-d69429b9eea4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:10.749089 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-353b6bf6-48b9-499a-a081-f48453371504 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:10.751063 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f4461fa-cddf-49a8-8898-d69429b9eea4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:10.751618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-353b6bf6-48b9-499a-a081-f48453371504 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:10.751944 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f4461fa-cddf-49a8-8898-d69429b9eea4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:10.753480 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f4461fa-cddf-49a8-8898-d69429b9eea4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:10.756340 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f4461fa-cddf-49a8-8898-d69429b9eea4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:10.756746 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-353b6bf6-48b9-499a-a081-f48453371504 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:10.757302 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-353b6bf6-48b9-499a-a081-f48453371504 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:10.974645 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-353b6bf6-48b9-499a-a081-f48453371504 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.253237 May 25 15:41:10.976435 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 96/184] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:10 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:11.234552 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2f4461fa-cddf-49a8-8898-d69429b9eea4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:11.236753 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-17308b27-6362-4b8d-b2a0-dcc859400063 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:11.237954 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-17308b27-6362-4b8d-b2a0-dcc859400063 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:11.243879 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2f4461fa-cddf-49a8-8898-d69429b9eea4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.508948 May 25 15:41:11.248219 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 89/185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:10 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:11.254162 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-17308b27-6362-4b8d-b2a0-dcc859400063 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:11.254646 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-17308b27-6362-4b8d-b2a0-dcc859400063 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:11.255461 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-17308b27-6362-4b8d-b2a0-dcc859400063 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:11.258842 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-17308b27-6362-4b8d-b2a0-dcc859400063 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:11.274815 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4848a954-dbe4-4a28-81a5-e68e3193027b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:11.275690 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4848a954-dbe4-4a28-81a5-e68e3193027b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:11.284417 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4848a954-dbe4-4a28-81a5-e68e3193027b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:11.285214 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4848a954-dbe4-4a28-81a5-e68e3193027b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:11.286636 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4848a954-dbe4-4a28-81a5-e68e3193027b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:11.287494 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4848a954-dbe4-4a28-81a5-e68e3193027b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:11.353571 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-4848a954-dbe4-4a28-81a5-e68e3193027b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] HTTP exception thrown: Instance 76837e96-02fc-46e9-bf8e-a0c0e19c1c19 could not be found. May 25 15:41:11.354631 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4848a954-dbe4-4a28-81a5-e68e3193027b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Returning 404 to user: Instance 76837e96-02fc-46e9-bf8e-a0c0e19c1c19 could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:41:11.355818 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4848a954-dbe4-4a28-81a5-e68e3193027b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 404 len: 111 microversion: 2.1 time: 0.084708 May 25 15:41:11.360864 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 90/186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:11 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:41:11.484670 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-17308b27-6362-4b8d-b2a0-dcc859400063 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.251784 May 25 15:41:11.485643 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 97/187] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:11 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:41:11.987249 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-78f61e82-4460-416b-a722-cfd7da4e6fd3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:11.988335 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-78f61e82-4460-416b-a722-cfd7da4e6fd3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:12.009581 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-78f61e82-4460-416b-a722-cfd7da4e6fd3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:12.010910 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-78f61e82-4460-416b-a722-cfd7da4e6fd3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:12.012499 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-78f61e82-4460-416b-a722-cfd7da4e6fd3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:12.019743 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-78f61e82-4460-416b-a722-cfd7da4e6fd3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:12.166526 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-78f61e82-4460-416b-a722-cfd7da4e6fd3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.183575 May 25 15:41:12.172832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 91/188] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:11 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:12.278021 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-02f997d1-78ca-4f41-aa23-8621016ab53d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:12.278756 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-02f997d1-78ca-4f41-aa23-8621016ab53d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:12.311158 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02f997d1-78ca-4f41-aa23-8621016ab53d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:12.311639 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02f997d1-78ca-4f41-aa23-8621016ab53d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:12.312483 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02f997d1-78ca-4f41-aa23-8621016ab53d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:12.318123 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02f997d1-78ca-4f41-aa23-8621016ab53d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:12.496441 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6a74ac6a-4db0-48ee-95a6-b61048ceaa19 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:12.497453 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6a74ac6a-4db0-48ee-95a6-b61048ceaa19 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:12.512672 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6a74ac6a-4db0-48ee-95a6-b61048ceaa19 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:12.517560 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6a74ac6a-4db0-48ee-95a6-b61048ceaa19 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:12.518507 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6a74ac6a-4db0-48ee-95a6-b61048ceaa19 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:12.520290 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6a74ac6a-4db0-48ee-95a6-b61048ceaa19 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:12.634843 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-02f997d1-78ca-4f41-aa23-8621016ab53d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:12.647818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-02f997d1-78ca-4f41-aa23-8621016ab53d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.387333 May 25 15:41:12.648770 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 98/189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:12 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:12.728565 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6a74ac6a-4db0-48ee-95a6-b61048ceaa19 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.236583 May 25 15:41:12.729492 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 92/190] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:12 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:41:13.178828 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3b2e86ae-446d-4fc8-acc9-8ddc1423e685 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:13.180917 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3b2e86ae-446d-4fc8-acc9-8ddc1423e685 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:13.198710 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b2e86ae-446d-4fc8-acc9-8ddc1423e685 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.199523 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b2e86ae-446d-4fc8-acc9-8ddc1423e685 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.200588 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b2e86ae-446d-4fc8-acc9-8ddc1423e685 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.201247 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b2e86ae-446d-4fc8-acc9-8ddc1423e685 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.391581 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3b2e86ae-446d-4fc8-acc9-8ddc1423e685 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.217334 May 25 15:41:13.392530 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 99/191] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:13 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:13.398667 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-45412d42-ad51-4810-b1b1-de259c661447 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:13.399275 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-45412d42-ad51-4810-b1b1-de259c661447 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:13.409266 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-45412d42-ad51-4810-b1b1-de259c661447 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.410777 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-45412d42-ad51-4810-b1b1-de259c661447 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.411771 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-45412d42-ad51-4810-b1b1-de259c661447 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.417059 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-45412d42-ad51-4810-b1b1-de259c661447 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.496796 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-45412d42-ad51-4810-b1b1-de259c661447 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] HTTP exception thrown: Instance 76837e96-02fc-46e9-bf8e-a0c0e19c1c19 could not be found. May 25 15:41:13.498185 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-45412d42-ad51-4810-b1b1-de259c661447 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Returning 404 to user: Instance 76837e96-02fc-46e9-bf8e-a0c0e19c1c19 could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:41:13.499603 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-45412d42-ad51-4810-b1b1-de259c661447 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "DELETE /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 404 len: 111 microversion: 2.1 time: 0.105118 May 25 15:41:13.500594 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 93/192] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:41:13 2021] DELETE /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:41:13.509914 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b506f405-06ed-490c-b939-4e4d8b1915c5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:13.510643 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b506f405-06ed-490c-b939-4e4d8b1915c5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] [instance: 76837e96-02fc-46e9-bf8e-a0c0e19c1c19] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:13.538117 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b506f405-06ed-490c-b939-4e4d8b1915c5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.541085 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b506f405-06ed-490c-b939-4e4d8b1915c5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.553116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b506f405-06ed-490c-b939-4e4d8b1915c5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.554317 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b506f405-06ed-490c-b939-4e4d8b1915c5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.651757 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-b506f405-06ed-490c-b939-4e4d8b1915c5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] HTTP exception thrown: Instance 76837e96-02fc-46e9-bf8e-a0c0e19c1c19 could not be found. May 25 15:41:13.655300 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b506f405-06ed-490c-b939-4e4d8b1915c5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Returning 404 to user: Instance 76837e96-02fc-46e9-bf8e-a0c0e19c1c19 could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:41:13.656571 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b506f405-06ed-490c-b939-4e4d8b1915c5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19" status: 404 len: 111 microversion: 2.1 time: 0.150747 May 25 15:41:13.657343 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 100/193] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:13 2021] GET /compute/v2.1/servers/76837e96-02fc-46e9-bf8e-a0c0e19c1c19 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:41:13.665839 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a77c2429-e918-456b-be98-f22a63218088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:13.666705 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a77c2429-e918-456b-be98-f22a63218088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:13.676846 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a77c2429-e918-456b-be98-f22a63218088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.677554 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a77c2429-e918-456b-be98-f22a63218088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.678508 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a77c2429-e918-456b-be98-f22a63218088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.679101 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a77c2429-e918-456b-be98-f22a63218088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.739705 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-55a96311-6a84-4912-a876-105df5e34834 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:13.741396 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-55a96311-6a84-4912-a876-105df5e34834 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:13.749902 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-55a96311-6a84-4912-a876-105df5e34834 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.750840 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-55a96311-6a84-4912-a876-105df5e34834 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.751854 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-55a96311-6a84-4912-a876-105df5e34834 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.753061 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-55a96311-6a84-4912-a876-105df5e34834 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.964100 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-55a96311-6a84-4912-a876-105df5e34834 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.228712 May 25 15:41:13.971655 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 101/194] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:13 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:14.266395 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a77c2429-e918-456b-be98-f22a63218088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:14.292766 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a77c2429-e918-456b-be98-f22a63218088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.631319 May 25 15:41:14.293940 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 94/195] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:13 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:14.403135 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-21817713-2362-4dbd-ae6d-c445b36d986e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:14.404159 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-21817713-2362-4dbd-ae6d-c445b36d986e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:14.414981 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-21817713-2362-4dbd-ae6d-c445b36d986e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:14.415449 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-21817713-2362-4dbd-ae6d-c445b36d986e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:14.416283 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-21817713-2362-4dbd-ae6d-c445b36d986e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:14.416738 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-21817713-2362-4dbd-ae6d-c445b36d986e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:14.578497 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-21817713-2362-4dbd-ae6d-c445b36d986e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.179317 May 25 15:41:14.579727 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 102/196] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:14 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:14.979244 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b8c3712e-ad1b-41d6-b8d4-87a2def97d99 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:14.981302 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b8c3712e-ad1b-41d6-b8d4-87a2def97d99 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:14.993232 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b8c3712e-ad1b-41d6-b8d4-87a2def97d99 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:15.004683 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b8c3712e-ad1b-41d6-b8d4-87a2def97d99 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:15.005572 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b8c3712e-ad1b-41d6-b8d4-87a2def97d99 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:15.006286 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b8c3712e-ad1b-41d6-b8d4-87a2def97d99 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:15.177532 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b8c3712e-ad1b-41d6-b8d4-87a2def97d99 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.202154 May 25 15:41:15.181173 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 95/197] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:14 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:15.313774 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3da5b362-1106-4911-89ef-411be576dd5d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:15.314452 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3da5b362-1106-4911-89ef-411be576dd5d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:15.329493 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3da5b362-1106-4911-89ef-411be576dd5d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:15.329956 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3da5b362-1106-4911-89ef-411be576dd5d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:15.330789 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3da5b362-1106-4911-89ef-411be576dd5d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:15.331226 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3da5b362-1106-4911-89ef-411be576dd5d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:15.591387 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-fb6e7112-c914-4dc0-8513-118941663b09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:15.593223 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-fb6e7112-c914-4dc0-8513-118941663b09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:15.606581 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fb6e7112-c914-4dc0-8513-118941663b09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:15.612940 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fb6e7112-c914-4dc0-8513-118941663b09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:15.614025 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fb6e7112-c914-4dc0-8513-118941663b09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:15.614749 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fb6e7112-c914-4dc0-8513-118941663b09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:15.846645 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-fb6e7112-c914-4dc0-8513-118941663b09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.259031 May 25 15:41:15.851057 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 96/198] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:15 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:15.904397 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3da5b362-1106-4911-89ef-411be576dd5d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:15.938507 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3da5b362-1106-4911-89ef-411be576dd5d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.629482 May 25 15:41:15.940464 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 103/199] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:15 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:16.189682 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-681c52b0-d669-4e84-93a1-6ecbe493acb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:16.195157 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-681c52b0-d669-4e84-93a1-6ecbe493acb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:16.222655 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-681c52b0-d669-4e84-93a1-6ecbe493acb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:16.223124 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-681c52b0-d669-4e84-93a1-6ecbe493acb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:16.225350 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-681c52b0-d669-4e84-93a1-6ecbe493acb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:16.226139 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-681c52b0-d669-4e84-93a1-6ecbe493acb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:16.359941 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-681c52b0-d669-4e84-93a1-6ecbe493acb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.173141 May 25 15:41:16.363412 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 97/200] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:16 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:16.863681 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-12efd57c-ad9a-471a-9d4a-2e8d6c1afefc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:16.864890 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-12efd57c-ad9a-471a-9d4a-2e8d6c1afefc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:16.910352 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-12efd57c-ad9a-471a-9d4a-2e8d6c1afefc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:16.914525 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-12efd57c-ad9a-471a-9d4a-2e8d6c1afefc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:16.915409 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-12efd57c-ad9a-471a-9d4a-2e8d6c1afefc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:16.915886 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-12efd57c-ad9a-471a-9d4a-2e8d6c1afefc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:16.957960 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-38ce827c-c4d8-40b6-ad66-1939566f6ebc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:16.958932 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-38ce827c-c4d8-40b6-ad66-1939566f6ebc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:16.975669 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-38ce827c-c4d8-40b6-ad66-1939566f6ebc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:16.976184 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-38ce827c-c4d8-40b6-ad66-1939566f6ebc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:16.977074 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-38ce827c-c4d8-40b6-ad66-1939566f6ebc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:16.977566 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-38ce827c-c4d8-40b6-ad66-1939566f6ebc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:17.143059 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-12efd57c-ad9a-471a-9d4a-2e8d6c1afefc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.281551 May 25 15:41:17.147245 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 104/201] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:16 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:17.372413 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d07266cc-b9b0-4cd4-a14b-c41b7de29e57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:17.373429 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d07266cc-b9b0-4cd4-a14b-c41b7de29e57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:17.388298 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-38ce827c-c4d8-40b6-ad66-1939566f6ebc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:17.397174 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d07266cc-b9b0-4cd4-a14b-c41b7de29e57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:17.397639 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d07266cc-b9b0-4cd4-a14b-c41b7de29e57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:17.400561 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d07266cc-b9b0-4cd4-a14b-c41b7de29e57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:17.401079 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d07266cc-b9b0-4cd4-a14b-c41b7de29e57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:17.403210 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-38ce827c-c4d8-40b6-ad66-1939566f6ebc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.450111 May 25 15:41:17.412670 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 98/202] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:16 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:41:17.653505 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d07266cc-b9b0-4cd4-a14b-c41b7de29e57 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.285855 May 25 15:41:17.657034 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 105/203] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:17 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:18.162980 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bab4c3b5-fa75-475c-9ad9-f916b6120183 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:18.164035 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bab4c3b5-fa75-475c-9ad9-f916b6120183 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:18.204519 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bab4c3b5-fa75-475c-9ad9-f916b6120183 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:18.205027 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bab4c3b5-fa75-475c-9ad9-f916b6120183 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:18.206066 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bab4c3b5-fa75-475c-9ad9-f916b6120183 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:18.212865 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bab4c3b5-fa75-475c-9ad9-f916b6120183 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:18.380679 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bab4c3b5-fa75-475c-9ad9-f916b6120183 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.225746 May 25 15:41:18.384626 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 99/204] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:18 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:18.433301 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8604cacc-fc4c-48de-abf8-50e2e0d76942 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:18.434704 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8604cacc-fc4c-48de-abf8-50e2e0d76942 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:18.445515 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8604cacc-fc4c-48de-abf8-50e2e0d76942 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:18.458850 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8604cacc-fc4c-48de-abf8-50e2e0d76942 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:18.461493 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8604cacc-fc4c-48de-abf8-50e2e0d76942 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:18.463565 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8604cacc-fc4c-48de-abf8-50e2e0d76942 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:18.666827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2de3cc5f-51cb-42fa-9c51-c97ab059af74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:18.667853 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2de3cc5f-51cb-42fa-9c51-c97ab059af74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:18.710537 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2de3cc5f-51cb-42fa-9c51-c97ab059af74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:18.711012 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2de3cc5f-51cb-42fa-9c51-c97ab059af74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:18.711825 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2de3cc5f-51cb-42fa-9c51-c97ab059af74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:18.712304 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2de3cc5f-51cb-42fa-9c51-c97ab059af74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:18.949373 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2de3cc5f-51cb-42fa-9c51-c97ab059af74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.287120 May 25 15:41:18.952825 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 100/205] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:18 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:19.138957 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-8604cacc-fc4c-48de-abf8-50e2e0d76942 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:19.154003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8604cacc-fc4c-48de-abf8-50e2e0d76942 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.726200 May 25 15:41:19.154832 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 106/206] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:18 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:19.392634 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1d89b8c6-48c9-4cce-a275-2ce95e2ca01d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:19.393667 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1d89b8c6-48c9-4cce-a275-2ce95e2ca01d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:19.402814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1d89b8c6-48c9-4cce-a275-2ce95e2ca01d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:19.403483 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1d89b8c6-48c9-4cce-a275-2ce95e2ca01d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:19.404986 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1d89b8c6-48c9-4cce-a275-2ce95e2ca01d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:19.405792 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1d89b8c6-48c9-4cce-a275-2ce95e2ca01d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:19.637530 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1d89b8c6-48c9-4cce-a275-2ce95e2ca01d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 14 microversion: 2.1 time: 0.249539 May 25 15:41:19.640717 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 101/207] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:19 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 14 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:19.960711 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9ce46d7c-df51-4bfb-8812-0a090a91c711 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:19.961663 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9ce46d7c-df51-4bfb-8812-0a090a91c711 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:19.976645 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9ce46d7c-df51-4bfb-8812-0a090a91c711 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:19.977368 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9ce46d7c-df51-4bfb-8812-0a090a91c711 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:19.978771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9ce46d7c-df51-4bfb-8812-0a090a91c711 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:19.982298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9ce46d7c-df51-4bfb-8812-0a090a91c711 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:20.173533 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b717f5b3-2fd2-4d98-aea6-6e35f75ff644 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:20.174450 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b717f5b3-2fd2-4d98-aea6-6e35f75ff644 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:20.186529 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9ce46d7c-df51-4bfb-8812-0a090a91c711 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14 microversion: 2.20 time: 0.230610 May 25 15:41:20.188528 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 107/208] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:19 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:20.199212 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b717f5b3-2fd2-4d98-aea6-6e35f75ff644 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:20.201145 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b717f5b3-2fd2-4d98-aea6-6e35f75ff644 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:20.204625 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b717f5b3-2fd2-4d98-aea6-6e35f75ff644 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:20.206183 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b717f5b3-2fd2-4d98-aea6-6e35f75ff644 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:20.595659 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b717f5b3-2fd2-4d98-aea6-6e35f75ff644 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:20.620588 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b717f5b3-2fd2-4d98-aea6-6e35f75ff644 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.452963 May 25 15:41:20.623099 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 102/209] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:20 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:20.649533 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-958a2749-e5ed-45cf-8701-a7bc634fc97d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:20.650715 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-958a2749-e5ed-45cf-8701-a7bc634fc97d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:20.665417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-958a2749-e5ed-45cf-8701-a7bc634fc97d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:20.665884 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-958a2749-e5ed-45cf-8701-a7bc634fc97d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:20.666689 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-958a2749-e5ed-45cf-8701-a7bc634fc97d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:20.667130 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-958a2749-e5ed-45cf-8701-a7bc634fc97d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:20.800705 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-958a2749-e5ed-45cf-8701-a7bc634fc97d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 6992 microversion: 2.1 time: 0.155422 May 25 15:41:20.804919 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 108/210] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:20 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 6992 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:21.198606 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-beb88ddb-019c-417b-a1a7-ae3c496d6807 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:21.205884 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-beb88ddb-019c-417b-a1a7-ae3c496d6807 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:21.217744 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-beb88ddb-019c-417b-a1a7-ae3c496d6807 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:21.218476 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-beb88ddb-019c-417b-a1a7-ae3c496d6807 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:21.219444 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-beb88ddb-019c-417b-a1a7-ae3c496d6807 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:21.220532 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-beb88ddb-019c-417b-a1a7-ae3c496d6807 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:21.381288 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-beb88ddb-019c-417b-a1a7-ae3c496d6807 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 3741 microversion: 2.20 time: 0.185354 May 25 15:41:21.381589 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 103/211] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:21 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 3741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:41:21.641434 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-414f17fc-b40a-4091-b529-e29b9ee10370 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:21.642329 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-414f17fc-b40a-4091-b529-e29b9ee10370 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:21.664307 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-414f17fc-b40a-4091-b529-e29b9ee10370 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:21.665142 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-414f17fc-b40a-4091-b529-e29b9ee10370 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:21.666176 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-414f17fc-b40a-4091-b529-e29b9ee10370 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:21.666844 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-414f17fc-b40a-4091-b529-e29b9ee10370 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:21.822587 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2446d371-d41c-4130-9416-04564beedde2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:21.823768 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2446d371-d41c-4130-9416-04564beedde2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:21.835946 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2446d371-d41c-4130-9416-04564beedde2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:21.840850 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2446d371-d41c-4130-9416-04564beedde2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:21.841899 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2446d371-d41c-4130-9416-04564beedde2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:21.842523 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2446d371-d41c-4130-9416-04564beedde2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:21.941061 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-414f17fc-b40a-4091-b529-e29b9ee10370 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:21.950523 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-414f17fc-b40a-4091-b529-e29b9ee10370 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.313362 May 25 15:41:21.951887 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 109/212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:21 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:22.026153 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2446d371-d41c-4130-9416-04564beedde2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 12093 microversion: 2.1 time: 0.211643 May 25 15:41:22.030695 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 104/213] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:21 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 12093 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:41:22.397083 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4f2981ca-bbf6-4d00-9740-164b371da236 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:22.398841 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4f2981ca-bbf6-4d00-9740-164b371da236 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:22.411407 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4f2981ca-bbf6-4d00-9740-164b371da236 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:22.412456 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4f2981ca-bbf6-4d00-9740-164b371da236 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:22.413963 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4f2981ca-bbf6-4d00-9740-164b371da236 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:22.414678 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4f2981ca-bbf6-4d00-9740-164b371da236 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:22.586042 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4f2981ca-bbf6-4d00-9740-164b371da236 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 9302 microversion: 2.20 time: 0.192440 May 25 15:41:22.587108 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 110/214] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:22 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 9302 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:41:22.970026 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-18fe9f78-0b70-4a37-93bc-856f525f30cc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:22.970830 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-18fe9f78-0b70-4a37-93bc-856f525f30cc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:22.987816 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-18fe9f78-0b70-4a37-93bc-856f525f30cc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:22.988556 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-18fe9f78-0b70-4a37-93bc-856f525f30cc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:22.989367 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-18fe9f78-0b70-4a37-93bc-856f525f30cc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:22.991814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-18fe9f78-0b70-4a37-93bc-856f525f30cc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:23.039270 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-63ad248b-99cc-4f8e-b251-5e98515719a2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:23.040691 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-63ad248b-99cc-4f8e-b251-5e98515719a2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:23.057291 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-63ad248b-99cc-4f8e-b251-5e98515719a2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:23.059190 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-63ad248b-99cc-4f8e-b251-5e98515719a2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:23.060035 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-63ad248b-99cc-4f8e-b251-5e98515719a2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:23.060485 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-63ad248b-99cc-4f8e-b251-5e98515719a2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:23.273670 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-63ad248b-99cc-4f8e-b251-5e98515719a2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 15110 microversion: 2.1 time: 0.237963 May 25 15:41:23.274489 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 111/215] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:23 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 15110 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:41:23.329443 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-18fe9f78-0b70-4a37-93bc-856f525f30cc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:23.339568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-18fe9f78-0b70-4a37-93bc-856f525f30cc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.374245 May 25 15:41:23.352250 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 105/216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:22 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:23.599456 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-017af106-fce4-4ad9-82f3-4817e8305f6b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:23.600587 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-017af106-fce4-4ad9-82f3-4817e8305f6b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:23.616680 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-017af106-fce4-4ad9-82f3-4817e8305f6b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:23.619136 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-017af106-fce4-4ad9-82f3-4817e8305f6b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:23.620010 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-017af106-fce4-4ad9-82f3-4817e8305f6b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:23.620567 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-017af106-fce4-4ad9-82f3-4817e8305f6b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:23.785908 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-017af106-fce4-4ad9-82f3-4817e8305f6b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 14837 microversion: 2.20 time: 0.191567 May 25 15:41:23.786561 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 112/217] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:23 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 14837 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:41:24.285684 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-26836b6a-69c6-4b21-8c95-721abbeb7073 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:24.286620 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-26836b6a-69c6-4b21-8c95-721abbeb7073 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:24.294983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-26836b6a-69c6-4b21-8c95-721abbeb7073 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:24.295446 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-26836b6a-69c6-4b21-8c95-721abbeb7073 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:24.296254 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-26836b6a-69c6-4b21-8c95-721abbeb7073 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:24.296693 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-26836b6a-69c6-4b21-8c95-721abbeb7073 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:24.358473 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-98ce5228-d852-4fbf-9c1a-64fcf651ee3c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:24.359190 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-98ce5228-d852-4fbf-9c1a-64fcf651ee3c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:24.374394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-98ce5228-d852-4fbf-9c1a-64fcf651ee3c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:24.374845 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-98ce5228-d852-4fbf-9c1a-64fcf651ee3c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:24.375637 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-98ce5228-d852-4fbf-9c1a-64fcf651ee3c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:24.376104 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-98ce5228-d852-4fbf-9c1a-64fcf651ee3c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:24.481383 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-26836b6a-69c6-4b21-8c95-721abbeb7073 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 17861 microversion: 2.1 time: 0.199839 May 25 15:41:24.482731 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 106/218] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:24 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 17861 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:41:24.673184 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-98ce5228-d852-4fbf-9c1a-64fcf651ee3c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:24.685647 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-98ce5228-d852-4fbf-9c1a-64fcf651ee3c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.331287 May 25 15:41:24.702624 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 113/219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:24 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:24.797663 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6b38bc5b-93fe-42dc-a372-ee425fa81a06 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:24.798711 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6b38bc5b-93fe-42dc-a372-ee425fa81a06 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:24.816123 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b38bc5b-93fe-42dc-a372-ee425fa81a06 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:24.816594 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b38bc5b-93fe-42dc-a372-ee425fa81a06 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:24.817381 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b38bc5b-93fe-42dc-a372-ee425fa81a06 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:24.817822 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b38bc5b-93fe-42dc-a372-ee425fa81a06 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:25.494183 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-262fbbe4-6fc8-4695-a686-1b0559827e79 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:25.495838 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-262fbbe4-6fc8-4695-a686-1b0559827e79 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:25.511174 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-262fbbe4-6fc8-4695-a686-1b0559827e79 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:25.511846 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-262fbbe4-6fc8-4695-a686-1b0559827e79 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:25.512833 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-262fbbe4-6fc8-4695-a686-1b0559827e79 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:25.513425 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-262fbbe4-6fc8-4695-a686-1b0559827e79 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:29.086427 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6b38bc5b-93fe-42dc-a372-ee425fa81a06 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 20593 microversion: 2.20 time: 4.292661 May 25 15:41:29.087442 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 107/220] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:24 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 20593 bytes in 4295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:41:29.092425 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bea573a9-f32b-4ac9-be32-29ef6ced71fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:29.093143 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bea573a9-f32b-4ac9-be32-29ef6ced71fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:29.106219 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-262fbbe4-6fc8-4695-a686-1b0559827e79 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 22217 microversion: 2.1 time: 3.615377 May 25 15:41:29.110098 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 114/221] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:25 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 22217 bytes in 3619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:41:29.113332 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-08a4a089-0691-42c3-b328-9f8f78b1c9b6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Action: 'create', calling method: .version_select at 0x7f08848a0e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1344186687"}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:29.116780 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bea573a9-f32b-4ac9-be32-29ef6ced71fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:29.117368 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bea573a9-f32b-4ac9-be32-29ef6ced71fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:29.118208 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bea573a9-f32b-4ac9-be32-29ef6ced71fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:29.118650 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bea573a9-f32b-4ac9-be32-29ef6ced71fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:29.154168 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-08a4a089-0691-42c3-b328-9f8f78b1c9b6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Getting quotas for project 55dc60a2768e4d2db35d44c21ff0e0a6. Resources: {'key_pairs'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:41:29.158771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-08a4a089-0691-42c3-b328-9f8f78b1c9b6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Getting quotas for user e1a0b13957524c3d9fbf483e593a6137 and project 55dc60a2768e4d2db35d44c21ff0e0a6. Resources: {'key_pairs'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:41:29.326157 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-bea573a9-f32b-4ac9-be32-29ef6ced71fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:29.335298 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bea573a9-f32b-4ac9-be32-29ef6ced71fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.246678 May 25 15:41:29.336086 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 108/222] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:29 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:29.468740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-08a4a089-0691-42c3-b328-9f8f78b1c9b6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Getting quotas for project 55dc60a2768e4d2db35d44c21ff0e0a6. Resources: {'key_pairs'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:41:29.473208 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-08a4a089-0691-42c3-b328-9f8f78b1c9b6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Getting quotas for user e1a0b13957524c3d9fbf483e593a6137 and project 55dc60a2768e4d2db35d44c21ff0e0a6. Resources: {'key_pairs'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:41:29.486919 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-08a4a089-0691-42c3-b328-9f8f78b1c9b6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.377214 May 25 15:41:29.487516 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 115/223] 10.222.0.36 () {60 vars in 1158 bytes} [Tue May 25 15:41:29 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:29.599798 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1203862695", "imageRef": "24056d73-4c8b-4c78-9266-d6753be2aca9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1344186687", "networks": [{"uuid": "07e4e701-ccf8-451e-b3d9-a809a6936fed"}]}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:29.664755 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.network.neutron [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] validate_networks() for [('07e4e701-ccf8-451e-b3d9-a809a6936fed', None, None, None)] {{(pid=112576) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:41:30.098949 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-649a5e73-a1ff-4a00-a3e6-1ec8ce59eb24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:30.099969 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-649a5e73-a1ff-4a00-a3e6-1ec8ce59eb24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:30.107814 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-649a5e73-a1ff-4a00-a3e6-1ec8ce59eb24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:30.108428 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-649a5e73-a1ff-4a00-a3e6-1ec8ce59eb24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:30.109111 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-649a5e73-a1ff-4a00-a3e6-1ec8ce59eb24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:30.109533 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-649a5e73-a1ff-4a00-a3e6-1ec8ce59eb24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:30.243369 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-649a5e73-a1ff-4a00-a3e6-1ec8ce59eb24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 21834 microversion: 2.20 time: 0.148410 May 25 15:41:30.244055 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 116/224] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:30 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 21834 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:41:30.250203 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4032068e-42ef-4dc6-9925-575f5c79aa0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:30.252659 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4032068e-42ef-4dc6-9925-575f5c79aa0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:30.262109 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4032068e-42ef-4dc6-9925-575f5c79aa0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:30.262760 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4032068e-42ef-4dc6-9925-575f5c79aa0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:30.263722 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4032068e-42ef-4dc6-9925-575f5c79aa0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:30.264196 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4032068e-42ef-4dc6-9925-575f5c79aa0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:30.291418 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Flavor limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:41:30.291927 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Image limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:41:30.292175 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Flavor pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:41:30.292592 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Image pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:41:30.293009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:41:30.303882 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:30.304391 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:30.305344 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:30.305787 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:30.323934 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Getting quotas for project 55dc60a2768e4d2db35d44c21ff0e0a6. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:41:30.328011 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Getting quotas for user e1a0b13957524c3d9fbf483e593a6137 and project 55dc60a2768e4d2db35d44c21ff0e0a6. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:41:30.339593 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Going to run 1 instances... {{(pid=112576) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:41:30.341886 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='24056d73-4c8b-4c78-9266-d6753be2aca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112576) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:41:30.392703 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-743a8892-449a-4924-af27-8383c5d3d131 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797696 May 25 15:41:30.394009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 109/225] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:41:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:41:30.397684 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4032068e-42ef-4dc6-9925-575f5c79aa0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 23134 microversion: 2.1 time: 0.151855 May 25 15:41:30.398596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 117/226] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:30 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 23134 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:41:30.400776 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-52fc535a-6349-457f-85a0-d2398bb8f0ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:30.401404 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-52fc535a-6349-457f-85a0-d2398bb8f0ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:30.409867 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-46c0ba6b-447f-40ee-b3ce-4bf13585e59c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:30.410818 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-52fc535a-6349-457f-85a0-d2398bb8f0ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:30.410920 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-52fc535a-6349-457f-85a0-d2398bb8f0ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:30.411714 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-52fc535a-6349-457f-85a0-d2398bb8f0ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:30.412207 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-52fc535a-6349-457f-85a0-d2398bb8f0ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:30.415377 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-46c0ba6b-447f-40ee-b3ce-4bf13585e59c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:30.561586 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-46c0ba6b-447f-40ee-b3ce-4bf13585e59c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:30.572763 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-46c0ba6b-447f-40ee-b3ce-4bf13585e59c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1259 microversion: 2.1 time: 0.169089 May 25 15:41:30.574625 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 118/227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:30 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:30.654125 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-52fc535a-6349-457f-85a0-d2398bb8f0ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:30.665052 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-52fc535a-6349-457f-85a0-d2398bb8f0ef tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.269794 May 25 15:41:30.665869 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 110/228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:30 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:31.255776 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8cebb5b7-96c8-4ee8-a058-113c77bd7327 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:31.256808 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8cebb5b7-96c8-4ee8-a058-113c77bd7327 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:31.265498 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8cebb5b7-96c8-4ee8-a058-113c77bd7327 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:31.265944 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8cebb5b7-96c8-4ee8-a058-113c77bd7327 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:31.267103 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8cebb5b7-96c8-4ee8-a058-113c77bd7327 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:31.267568 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8cebb5b7-96c8-4ee8-a058-113c77bd7327 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:31.385694 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8cebb5b7-96c8-4ee8-a058-113c77bd7327 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 22888 microversion: 2.20 time: 0.134061 May 25 15:41:31.387404 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 119/229] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:31 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 22888 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:41:31.410256 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4bf25253-09f3-42d6-b740-e98fe58540f4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:31.411260 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4bf25253-09f3-42d6-b740-e98fe58540f4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:31.419817 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4bf25253-09f3-42d6-b740-e98fe58540f4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:31.420315 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4bf25253-09f3-42d6-b740-e98fe58540f4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:31.421105 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4bf25253-09f3-42d6-b740-e98fe58540f4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:31.421540 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4bf25253-09f3-42d6-b740-e98fe58540f4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:31.560329 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4bf25253-09f3-42d6-b740-e98fe58540f4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 23798 microversion: 2.1 time: 0.154496 May 25 15:41:31.564767 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 111/230] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:31 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 23798 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:41:31.590970 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-af06c38a-79c0-4363-a214-a1cde9013aae tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:31.591764 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-af06c38a-79c0-4363-a214-a1cde9013aae tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:31.600081 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-af06c38a-79c0-4363-a214-a1cde9013aae tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:31.600622 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-af06c38a-79c0-4363-a214-a1cde9013aae tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:31.601488 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-af06c38a-79c0-4363-a214-a1cde9013aae tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:31.602002 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-af06c38a-79c0-4363-a214-a1cde9013aae tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:31.696195 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-baf8abe7-209b-4681-aadd-1d071d873bb5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:31.696763 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-baf8abe7-209b-4681-aadd-1d071d873bb5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:31.706483 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-baf8abe7-209b-4681-aadd-1d071d873bb5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:31.707941 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-baf8abe7-209b-4681-aadd-1d071d873bb5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:31.709515 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-baf8abe7-209b-4681-aadd-1d071d873bb5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:31.710109 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-baf8abe7-209b-4681-aadd-1d071d873bb5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:31.769098 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-af06c38a-79c0-4363-a214-a1cde9013aae tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:31.780285 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-af06c38a-79c0-4363-a214-a1cde9013aae tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1311 microversion: 2.1 time: 0.193015 May 25 15:41:31.791653 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 120/231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:31 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1311 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:32.036907 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-baf8abe7-209b-4681-aadd-1d071d873bb5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:32.048306 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-baf8abe7-209b-4681-aadd-1d071d873bb5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.361731 May 25 15:41:32.049630 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 112/232] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:31 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:32.398465 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dd0e118f-98a0-4804-9719-616d363f39ab tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:32.399424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-dd0e118f-98a0-4804-9719-616d363f39ab tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:32.415431 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dd0e118f-98a0-4804-9719-616d363f39ab tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:32.415906 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dd0e118f-98a0-4804-9719-616d363f39ab tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:32.416714 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dd0e118f-98a0-4804-9719-616d363f39ab tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:32.417171 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dd0e118f-98a0-4804-9719-616d363f39ab tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:32.574275 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f2b881c1-1fed-4d52-a6ee-b62333969ff0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:32.575355 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f2b881c1-1fed-4d52-a6ee-b62333969ff0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:32.600677 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dd0e118f-98a0-4804-9719-616d363f39ab tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 23795 microversion: 2.20 time: 0.206957 May 25 15:41:32.601502 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 121/233] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:32 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 23795 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:41:32.604661 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f2b881c1-1fed-4d52-a6ee-b62333969ff0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:32.605716 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f2b881c1-1fed-4d52-a6ee-b62333969ff0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:32.606722 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f2b881c1-1fed-4d52-a6ee-b62333969ff0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:32.607324 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f2b881c1-1fed-4d52-a6ee-b62333969ff0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:32.805545 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a2b9a6b3-24e7-4067-9a48-913464f0991f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:32.806564 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a2b9a6b3-24e7-4067-9a48-913464f0991f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:32.819218 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a2b9a6b3-24e7-4067-9a48-913464f0991f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:32.819827 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a2b9a6b3-24e7-4067-9a48-913464f0991f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:32.821041 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a2b9a6b3-24e7-4067-9a48-913464f0991f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:32.821481 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a2b9a6b3-24e7-4067-9a48-913464f0991f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:32.827276 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f2b881c1-1fed-4d52-a6ee-b62333969ff0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 24766 microversion: 2.1 time: 0.256579 May 25 15:41:32.833786 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 113/234] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:32 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 24766 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:41:33.000197 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a2b9a6b3-24e7-4067-9a48-913464f0991f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:33.023273 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a2b9a6b3-24e7-4067-9a48-913464f0991f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1317 microversion: 2.1 time: 0.227834 May 25 15:41:33.024162 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 122/235] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:32 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:41:33.067242 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e1047fb1-12e1-4f51-8f47-83be1ec63fb4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:33.068103 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e1047fb1-12e1-4f51-8f47-83be1ec63fb4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:33.096093 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e1047fb1-12e1-4f51-8f47-83be1ec63fb4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:33.096826 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e1047fb1-12e1-4f51-8f47-83be1ec63fb4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:33.097707 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e1047fb1-12e1-4f51-8f47-83be1ec63fb4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:33.098220 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e1047fb1-12e1-4f51-8f47-83be1ec63fb4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:33.527344 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-e1047fb1-12e1-4f51-8f47-83be1ec63fb4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:33.540204 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e1047fb1-12e1-4f51-8f47-83be1ec63fb4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.477322 May 25 15:41:33.540406 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 114/236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:33 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:33.613297 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1410efea-2d61-4b78-a3bc-c33c7a4125e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:33.614235 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1410efea-2d61-4b78-a3bc-c33c7a4125e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:33.632209 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1410efea-2d61-4b78-a3bc-c33c7a4125e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:33.632682 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1410efea-2d61-4b78-a3bc-c33c7a4125e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:33.633495 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1410efea-2d61-4b78-a3bc-c33c7a4125e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:33.634030 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1410efea-2d61-4b78-a3bc-c33c7a4125e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:33.851004 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a56af7d2-1ae6-48eb-9161-86853575aef3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:33.852646 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a56af7d2-1ae6-48eb-9161-86853575aef3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:33.862415 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a56af7d2-1ae6-48eb-9161-86853575aef3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:33.863081 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a56af7d2-1ae6-48eb-9161-86853575aef3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:33.864160 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a56af7d2-1ae6-48eb-9161-86853575aef3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:33.864791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a56af7d2-1ae6-48eb-9161-86853575aef3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:50.399918 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1410efea-2d61-4b78-a3bc-c33c7a4125e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 28286 microversion: 2.20 time: 16.790572 May 25 15:41:50.401008 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 123/237] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:33 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 28286 bytes in 16792 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:41:50.406729 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a56af7d2-1ae6-48eb-9161-86853575aef3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 28255 microversion: 2.1 time: 16.570216 May 25 15:41:50.407542 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:50.410881 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 115/238] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:33 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 28255 bytes in 16572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:41:50.411999 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:50.413975 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7c3144d8-ffd0-4f00-a846-465898edaafa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:50.414788 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7c3144d8-ffd0-4f00-a846-465898edaafa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:50.423362 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7c3144d8-ffd0-4f00-a846-465898edaafa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:50.423545 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:50.424156 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7c3144d8-ffd0-4f00-a846-465898edaafa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:50.424750 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:50.425259 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7c3144d8-ffd0-4f00-a846-465898edaafa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:50.425754 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:50.426180 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7c3144d8-ffd0-4f00-a846-465898edaafa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:50.426404 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:50.684459 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7c3144d8-ffd0-4f00-a846-465898edaafa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:50.700445 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7c3144d8-ffd0-4f00-a846-465898edaafa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.290521 May 25 15:41:50.701317 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 116/239] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:50 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:50.707618 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2119419680", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:50.801655 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.network.neutron [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] validate_networks() for None {{(pid=112576) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:41:50.913415 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:50.927840 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1359 microversion: 2.1 time: 0.523919 May 25 15:41:50.930644 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 124/240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:50 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1359 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:51.085931 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Flavor limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:41:51.086480 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Image limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:41:51.087064 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Flavor pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:41:51.087705 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Image pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:41:51.088218 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:41:51.098217 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.098669 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.099526 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.100018 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.119526 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Getting quotas for project be5fb171d503440e86a06009ac0dceef. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:41:51.123987 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Getting quotas for user 017b1d106d0840e185adfa07aa95af62 and project be5fb171d503440e86a06009ac0dceef. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:41:51.137013 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Going to run 1 instances... {{(pid=112576) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:41:51.140042 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112576) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:41:51.184487 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d2aeb8d6-43de-4f16-b521-75586aff00e6 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.481533 May 25 15:41:51.185303 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 117/241] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:41:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:41:51.195319 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-224b8b99-ac6b-4f6b-b22a-497f5e22fdf2 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:51.195975 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-224b8b99-ac6b-4f6b-b22a-497f5e22fdf2 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:51.340651 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-224b8b99-ac6b-4f6b-b22a-497f5e22fdf2 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:51.356197 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-224b8b99-ac6b-4f6b-b22a-497f5e22fdf2 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1215 microversion: 2.1 time: 0.164293 May 25 15:41:51.357671 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 125/242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:51 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:51.412077 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-87913fdc-886c-4e11-8df2-2269556895cc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:51.413078 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-87913fdc-886c-4e11-8df2-2269556895cc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:51.420439 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-20aa5bb7-100c-423c-b030-ed6ff2470cd0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:51.421897 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-20aa5bb7-100c-423c-b030-ed6ff2470cd0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:51.433867 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-20aa5bb7-100c-423c-b030-ed6ff2470cd0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.434355 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-20aa5bb7-100c-423c-b030-ed6ff2470cd0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.435198 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-20aa5bb7-100c-423c-b030-ed6ff2470cd0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.436104 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-20aa5bb7-100c-423c-b030-ed6ff2470cd0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.446951 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87913fdc-886c-4e11-8df2-2269556895cc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.448122 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87913fdc-886c-4e11-8df2-2269556895cc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.449405 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87913fdc-886c-4e11-8df2-2269556895cc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.450027 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87913fdc-886c-4e11-8df2-2269556895cc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.576531 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-20aa5bb7-100c-423c-b030-ed6ff2470cd0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 28383 microversion: 2.1 time: 0.161367 May 25 15:41:51.578358 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 126/243] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:51 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 28383 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:41:51.653087 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-87913fdc-886c-4e11-8df2-2269556895cc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 28286 microversion: 2.20 time: 0.244567 May 25 15:41:51.655904 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 118/244] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:51 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 28286 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:41:51.717718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-388de10c-5bee-49f9-97e6-22adabc27f6f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:51.718596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-388de10c-5bee-49f9-97e6-22adabc27f6f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:51.729190 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-388de10c-5bee-49f9-97e6-22adabc27f6f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.734692 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-388de10c-5bee-49f9-97e6-22adabc27f6f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.736978 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-388de10c-5bee-49f9-97e6-22adabc27f6f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.737913 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-388de10c-5bee-49f9-97e6-22adabc27f6f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.750263 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-96751b8c-8145-41f2-adf2-08ef8f9077b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e39efa-e568-41dd-9368-376ead8b1020", "tag": "c536b9e5-ae17-4775-b209-71e6ec42122a"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:51.755098 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:41:51.755098 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:41:51.779491 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-96751b8c-8145-41f2-adf2-08ef8f9077b6 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.787213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-96751b8c-8145-41f2-adf2-08ef8f9077b6 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.807735 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-96751b8c-8145-41f2-adf2-08ef8f9077b6 service nova] Creating event network-changed:c536b9e5-ae17-4775-b209-71e6ec42122a for instance 17e39efa-e568-41dd-9368-376ead8b1020 on hv-cinder-79123 May 25 15:41:51.816884 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-96751b8c-8145-41f2-adf2-08ef8f9077b6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071455 May 25 15:41:51.818248 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 119/245] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:41:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:41:51.950793 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3fe57fc2-056d-4092-84e5-7e2b9057146f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:51.954370 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-3fe57fc2-056d-4092-84e5-7e2b9057146f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:51.962432 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3fe57fc2-056d-4092-84e5-7e2b9057146f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.963159 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3fe57fc2-056d-4092-84e5-7e2b9057146f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.964368 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3fe57fc2-056d-4092-84e5-7e2b9057146f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.965014 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3fe57fc2-056d-4092-84e5-7e2b9057146f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:52.319079 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3fe57fc2-056d-4092-84e5-7e2b9057146f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:52.331504 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3fe57fc2-056d-4092-84e5-7e2b9057146f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1359 microversion: 2.1 time: 0.386001 May 25 15:41:52.332470 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 120/246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:51 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1359 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:52.373190 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9ea6aa5a-f3b2-4ba2-b6b7-5386d6fe0a19 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:52.373826 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9ea6aa5a-f3b2-4ba2-b6b7-5386d6fe0a19 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:52.384277 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9ea6aa5a-f3b2-4ba2-b6b7-5386d6fe0a19 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:52.385069 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9ea6aa5a-f3b2-4ba2-b6b7-5386d6fe0a19 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:52.385845 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9ea6aa5a-f3b2-4ba2-b6b7-5386d6fe0a19 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:52.386354 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9ea6aa5a-f3b2-4ba2-b6b7-5386d6fe0a19 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:52.510551 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-388de10c-5bee-49f9-97e6-22adabc27f6f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:52.523618 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9ea6aa5a-f3b2-4ba2-b6b7-5386d6fe0a19 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:52.527505 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-388de10c-5bee-49f9-97e6-22adabc27f6f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.813809 May 25 15:41:52.530992 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 127/247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:51 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:52.533966 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9ea6aa5a-f3b2-4ba2-b6b7-5386d6fe0a19 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1267 microversion: 2.1 time: 0.164418 May 25 15:41:52.535790 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 121/248] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:52 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:41:52.588900 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-27618776-ce3e-4a2c-88b9-1556f92ab1b8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:52.590031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-27618776-ce3e-4a2c-88b9-1556f92ab1b8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:52.598660 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-27618776-ce3e-4a2c-88b9-1556f92ab1b8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:52.599282 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-27618776-ce3e-4a2c-88b9-1556f92ab1b8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:52.600181 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-27618776-ce3e-4a2c-88b9-1556f92ab1b8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:52.600740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-27618776-ce3e-4a2c-88b9-1556f92ab1b8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:52.666672 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ed541a75-914a-4bc8-a7bb-98fd0850257b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:52.668379 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ed541a75-914a-4bc8-a7bb-98fd0850257b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:52.676665 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed541a75-914a-4bc8-a7bb-98fd0850257b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:52.677217 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed541a75-914a-4bc8-a7bb-98fd0850257b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:52.677914 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed541a75-914a-4bc8-a7bb-98fd0850257b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:52.678381 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed541a75-914a-4bc8-a7bb-98fd0850257b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:52.787738 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-27618776-ce3e-4a2c-88b9-1556f92ab1b8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 28546 microversion: 2.1 time: 0.202592 May 25 15:41:52.788365 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 128/249] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:52 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 28546 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:41:52.855627 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ed541a75-914a-4bc8-a7bb-98fd0850257b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 28577 microversion: 2.20 time: 0.193061 May 25 15:41:52.856344 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 122/250] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:52 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 28577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:41:53.349258 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b15eee5a-82ca-4907-b659-05996e6de4a0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:53.350324 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b15eee5a-82ca-4907-b659-05996e6de4a0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:53.360104 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b15eee5a-82ca-4907-b659-05996e6de4a0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:53.360815 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b15eee5a-82ca-4907-b659-05996e6de4a0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:53.361949 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b15eee5a-82ca-4907-b659-05996e6de4a0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:53.363651 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b15eee5a-82ca-4907-b659-05996e6de4a0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:53.549658 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-86a0e16a-042f-4bfd-bba2-4d82b0d9b387 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:53.551444 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-86a0e16a-042f-4bfd-bba2-4d82b0d9b387 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:53.566869 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-86a0e16a-042f-4bfd-bba2-4d82b0d9b387 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:53.567639 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-86a0e16a-042f-4bfd-bba2-4d82b0d9b387 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:53.568658 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-86a0e16a-042f-4bfd-bba2-4d82b0d9b387 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:53.569250 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-86a0e16a-042f-4bfd-bba2-4d82b0d9b387 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:53.785558 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-86a0e16a-042f-4bfd-bba2-4d82b0d9b387 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:53.796698 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-86a0e16a-042f-4bfd-bba2-4d82b0d9b387 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1523 microversion: 2.1 time: 0.252491 May 25 15:41:53.798099 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 123/251] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:53 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:53.804018 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-110c4d84-5a75-4bfa-91ce-5105a69e93df tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:53.805007 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-110c4d84-5a75-4bfa-91ce-5105a69e93df tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:53.818168 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-110c4d84-5a75-4bfa-91ce-5105a69e93df tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:53.818829 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-110c4d84-5a75-4bfa-91ce-5105a69e93df tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:53.819614 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-110c4d84-5a75-4bfa-91ce-5105a69e93df tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:53.820445 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-110c4d84-5a75-4bfa-91ce-5105a69e93df tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:53.833077 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b15eee5a-82ca-4907-b659-05996e6de4a0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:53.841842 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b15eee5a-82ca-4907-b659-05996e6de4a0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1359 microversion: 2.1 time: 0.497139 May 25 15:41:53.842614 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 129/252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:53 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1359 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:41:53.857464 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1b9ebf71-06e0-41c0-9025-3d3103a0770b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:53.858515 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1b9ebf71-06e0-41c0-9025-3d3103a0770b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:53.866911 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1b9ebf71-06e0-41c0-9025-3d3103a0770b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:53.867397 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1b9ebf71-06e0-41c0-9025-3d3103a0770b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:53.868338 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1b9ebf71-06e0-41c0-9025-3d3103a0770b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:53.868856 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1b9ebf71-06e0-41c0-9025-3d3103a0770b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:53.953800 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-110c4d84-5a75-4bfa-91ce-5105a69e93df tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:53.962987 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-110c4d84-5a75-4bfa-91ce-5105a69e93df tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1273 microversion: 2.1 time: 0.163089 May 25 15:41:53.963555 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 124/253] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:53 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:53.968055 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d626b616-fc33-4aa6-a40c-4d61f3a7dc44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:53.969028 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d626b616-fc33-4aa6-a40c-4d61f3a7dc44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:53.976463 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d626b616-fc33-4aa6-a40c-4d61f3a7dc44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:53.977446 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d626b616-fc33-4aa6-a40c-4d61f3a7dc44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:53.978260 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d626b616-fc33-4aa6-a40c-4d61f3a7dc44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:53.978706 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d626b616-fc33-4aa6-a40c-4d61f3a7dc44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:54.034594 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1b9ebf71-06e0-41c0-9025-3d3103a0770b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 28595 microversion: 2.1 time: 0.180490 May 25 15:41:54.035889 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 130/254] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:53 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 28595 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:41:54.120374 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d626b616-fc33-4aa6-a40c-4d61f3a7dc44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 28577 microversion: 2.20 time: 0.155353 May 25 15:41:54.121493 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 125/255] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:53 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 28577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:41:54.825096 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2f4d7df3-ebf8-400c-84e3-d4c99e276cc5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:54.826183 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2f4d7df3-ebf8-400c-84e3-d4c99e276cc5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:54.837754 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f4d7df3-ebf8-400c-84e3-d4c99e276cc5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:54.838316 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f4d7df3-ebf8-400c-84e3-d4c99e276cc5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:54.839110 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f4d7df3-ebf8-400c-84e3-d4c99e276cc5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:54.839548 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f4d7df3-ebf8-400c-84e3-d4c99e276cc5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:54.860989 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a4e3318d-36ea-40c6-8a8d-4ee8be3e4606 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:54.861710 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a4e3318d-36ea-40c6-8a8d-4ee8be3e4606 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:54.883034 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a4e3318d-36ea-40c6-8a8d-4ee8be3e4606 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:54.883707 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a4e3318d-36ea-40c6-8a8d-4ee8be3e4606 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:54.884979 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a4e3318d-36ea-40c6-8a8d-4ee8be3e4606 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:54.886012 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a4e3318d-36ea-40c6-8a8d-4ee8be3e4606 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.176494 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a4e3318d-36ea-40c6-8a8d-4ee8be3e4606 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:55.190624 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a4e3318d-36ea-40c6-8a8d-4ee8be3e4606 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1359 microversion: 2.1 time: 0.333689 May 25 15:41:55.193268 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 126/256] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:54 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1359 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:41:55.209077 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-fc9a3553-5596-4921-a646-c9f8c06f6ac9 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:55.211819 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-fc9a3553-5596-4921-a646-c9f8c06f6ac9 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:55.223816 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fc9a3553-5596-4921-a646-c9f8c06f6ac9 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.224312 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fc9a3553-5596-4921-a646-c9f8c06f6ac9 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.225174 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fc9a3553-5596-4921-a646-c9f8c06f6ac9 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.225647 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fc9a3553-5596-4921-a646-c9f8c06f6ac9 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.363561 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2f4d7df3-ebf8-400c-84e3-d4c99e276cc5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:55.372591 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2f4d7df3-ebf8-400c-84e3-d4c99e276cc5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1503 microversion: 2.1 time: 0.557728 May 25 15:41:55.373175 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 131/257] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:54 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1503 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:55.384531 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6df18f68-c1f9-4bc3-9242-16367736764c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:55.385878 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6df18f68-c1f9-4bc3-9242-16367736764c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:55.394372 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6df18f68-c1f9-4bc3-9242-16367736764c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.394824 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6df18f68-c1f9-4bc3-9242-16367736764c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.396074 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6df18f68-c1f9-4bc3-9242-16367736764c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.396788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6df18f68-c1f9-4bc3-9242-16367736764c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.520893 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6df18f68-c1f9-4bc3-9242-16367736764c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 28712 microversion: 2.1 time: 0.145427 May 25 15:41:55.523011 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 132/258] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:55 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 28712 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:41:55.535527 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ce839f47-e63c-4ecb-895c-d86fe39a6379 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:55.537148 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ce839f47-e63c-4ecb-895c-d86fe39a6379 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:55.550384 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce839f47-e63c-4ecb-895c-d86fe39a6379 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.550953 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce839f47-e63c-4ecb-895c-d86fe39a6379 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.551998 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce839f47-e63c-4ecb-895c-d86fe39a6379 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.553503 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce839f47-e63c-4ecb-895c-d86fe39a6379 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.627211 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-fc9a3553-5596-4921-a646-c9f8c06f6ac9 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:55.637781 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-fc9a3553-5596-4921-a646-c9f8c06f6ac9 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1315 microversion: 2.1 time: 0.434831 May 25 15:41:55.647746 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 127/259] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:55 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:55.647746 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9370ee99-e57a-404d-ac67-e6dc5abf4708 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:55.647746 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9370ee99-e57a-404d-ac67-e6dc5abf4708 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:55.652064 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9370ee99-e57a-404d-ac67-e6dc5abf4708 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.652291 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9370ee99-e57a-404d-ac67-e6dc5abf4708 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.653088 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9370ee99-e57a-404d-ac67-e6dc5abf4708 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.653615 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9370ee99-e57a-404d-ac67-e6dc5abf4708 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.684799 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ce839f47-e63c-4ecb-895c-d86fe39a6379 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 28745 microversion: 2.20 time: 0.158815 May 25 15:41:55.685481 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 133/260] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:55 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 28745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:41:55.871756 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9370ee99-e57a-404d-ac67-e6dc5abf4708 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:55.885592 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9370ee99-e57a-404d-ac67-e6dc5abf4708 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1516 microversion: 2.1 time: 0.244817 May 25 15:41:55.886509 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 128/261] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:55 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:56.220176 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ebd94380-0cfa-491a-9e47-61ac29fdcf20 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:56.222353 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ebd94380-0cfa-491a-9e47-61ac29fdcf20 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:56.232114 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ebd94380-0cfa-491a-9e47-61ac29fdcf20 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.232959 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ebd94380-0cfa-491a-9e47-61ac29fdcf20 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.234061 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ebd94380-0cfa-491a-9e47-61ac29fdcf20 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.234718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ebd94380-0cfa-491a-9e47-61ac29fdcf20 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.537558 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-23e73fd4-5b61-4266-8e50-fb4526841f4b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:56.539127 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-23e73fd4-5b61-4266-8e50-fb4526841f4b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:56.549491 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-23e73fd4-5b61-4266-8e50-fb4526841f4b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.550857 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-23e73fd4-5b61-4266-8e50-fb4526841f4b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.552099 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-23e73fd4-5b61-4266-8e50-fb4526841f4b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.552843 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-23e73fd4-5b61-4266-8e50-fb4526841f4b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.672497 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ebd94380-0cfa-491a-9e47-61ac29fdcf20 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:56.677765 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-23e73fd4-5b61-4266-8e50-fb4526841f4b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 28712 microversion: 2.1 time: 0.147356 May 25 15:41:56.678876 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 129/262] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:56 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 28712 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:41:56.684994 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-80c788fb-886f-41ad-8f72-b2c6b9bc0dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cefa816-94bd-4b6c-ba1e-c71f7b539bf3", "tag": "0d049ba8-f49c-4e51-b70c-b3c7bcb786d5"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:56.687757 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ebd94380-0cfa-491a-9e47-61ac29fdcf20 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1359 microversion: 2.1 time: 0.482229 May 25 15:41:56.692696 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:41:56.692696 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:41:56.698150 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 134/263] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:56 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1359 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:56.704102 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:56.705031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:56.712226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-80c788fb-886f-41ad-8f72-b2c6b9bc0dd2 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.712831 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-80c788fb-886f-41ad-8f72-b2c6b9bc0dd2 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.715023 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.715661 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.716645 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.717248 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.740174 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-80c788fb-886f-41ad-8f72-b2c6b9bc0dd2 service nova] Creating event network-changed:0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 for instance 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 on hv-cinder-79123 May 25 15:41:56.745478 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-80c788fb-886f-41ad-8f72-b2c6b9bc0dd2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064993 May 25 15:41:56.747793 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 130/264] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:41:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:41:56.756330 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b0eabb58-9713-4405-b7f4-343c7f997ce5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:56.757833 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b0eabb58-9713-4405-b7f4-343c7f997ce5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:56.766823 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b0eabb58-9713-4405-b7f4-343c7f997ce5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.767564 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b0eabb58-9713-4405-b7f4-343c7f997ce5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.769671 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b0eabb58-9713-4405-b7f4-343c7f997ce5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.771117 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b0eabb58-9713-4405-b7f4-343c7f997ce5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.911621 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b0eabb58-9713-4405-b7f4-343c7f997ce5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 28745 microversion: 2.20 time: 0.161643 May 25 15:41:56.912498 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 131/265] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:56 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 28745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:41:57.280917 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:57.290066 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1315 microversion: 2.1 time: 0.589754 May 25 15:41:57.290657 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 135/266] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:56 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:57.602983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-767cb392-e68e-4436-836e-f570868d57b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:57.604081 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-767cb392-e68e-4436-836e-f570868d57b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:57.611943 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-767cb392-e68e-4436-836e-f570868d57b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:57.612903 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-767cb392-e68e-4436-836e-f570868d57b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:57.613686 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-767cb392-e68e-4436-836e-f570868d57b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:57.614131 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-767cb392-e68e-4436-836e-f570868d57b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:57.674497 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-767cb392-e68e-4436-836e-f570868d57b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lazy-loading 'flavor' on Instance uuid 1b62e88c-87e4-4020-9fc4-9b2cffdc55de {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:41:57.689308 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-18dfe679-0cfd-49f7-aac2-585db5597a02 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:57.690488 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-18dfe679-0cfd-49f7-aac2-585db5597a02 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:57.698093 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-18dfe679-0cfd-49f7-aac2-585db5597a02 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:57.700829 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-18dfe679-0cfd-49f7-aac2-585db5597a02 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:57.701635 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-18dfe679-0cfd-49f7-aac2-585db5597a02 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:57.702075 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-18dfe679-0cfd-49f7-aac2-585db5597a02 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:57.825471 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-767cb392-e68e-4436-836e-f570868d57b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "POST /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/action" status: 200 len: 32 microversion: 2.1 time: 0.226814 May 25 15:41:57.826084 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 132/267] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:57 2021] POST /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/action => generated 32 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:41:57.831574 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8aab9ef7-2255-4b6d-aaa9-4763278a9871 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:57.832322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8aab9ef7-2255-4b6d-aaa9-4763278a9871 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:57.838694 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-18dfe679-0cfd-49f7-aac2-585db5597a02 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 28712 microversion: 2.1 time: 0.152943 May 25 15:41:57.839444 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 136/268] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:57 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 28712 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:41:57.840562 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8aab9ef7-2255-4b6d-aaa9-4763278a9871 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:57.841029 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8aab9ef7-2255-4b6d-aaa9-4763278a9871 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:57.841824 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8aab9ef7-2255-4b6d-aaa9-4763278a9871 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:57.842278 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8aab9ef7-2255-4b6d-aaa9-4763278a9871 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:57.847210 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-30dfd875-dc01-4535-8ee5-d0c385647b1d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:57.848189 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-30dfd875-dc01-4535-8ee5-d0c385647b1d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:57.858670 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-30dfd875-dc01-4535-8ee5-d0c385647b1d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:57.859604 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-30dfd875-dc01-4535-8ee5-d0c385647b1d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:57.860953 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-30dfd875-dc01-4535-8ee5-d0c385647b1d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:57.862116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-30dfd875-dc01-4535-8ee5-d0c385647b1d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:58.064621 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8aab9ef7-2255-4b6d-aaa9-4763278a9871 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:58.073509 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8aab9ef7-2255-4b6d-aaa9-4763278a9871 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1359 microversion: 2.1 time: 0.246289 May 25 15:41:58.074085 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 133/269] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:57 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:58.078893 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-caa86bf0-599e-4d1e-8329-964553714742 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:58.080492 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-caa86bf0-599e-4d1e-8329-964553714742 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:58.087711 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-caa86bf0-599e-4d1e-8329-964553714742 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:58.088220 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-caa86bf0-599e-4d1e-8329-964553714742 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:58.088996 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-caa86bf0-599e-4d1e-8329-964553714742 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:58.089435 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-caa86bf0-599e-4d1e-8329-964553714742 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:58.212356 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-caa86bf0-599e-4d1e-8329-964553714742 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 28745 microversion: 2.20 time: 0.136711 May 25 15:41:58.213228 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 134/270] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:58 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 28745 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:41:58.307533 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-11eff962-7568-428c-9f2c-c2b3d0556f1a tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:58.308383 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-11eff962-7568-428c-9f2c-c2b3d0556f1a tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:58.317112 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-11eff962-7568-428c-9f2c-c2b3d0556f1a tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:58.317483 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-11eff962-7568-428c-9f2c-c2b3d0556f1a tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:58.318258 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-11eff962-7568-428c-9f2c-c2b3d0556f1a tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:58.318697 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-11eff962-7568-428c-9f2c-c2b3d0556f1a tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:58.358151 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-30dfd875-dc01-4535-8ee5-d0c385647b1d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:58.369486 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-30dfd875-dc01-4535-8ee5-d0c385647b1d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.528475 May 25 15:41:58.370667 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 137/271] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:57 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:58.524564 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-11eff962-7568-428c-9f2c-c2b3d0556f1a tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:58.533177 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-11eff962-7568-428c-9f2c-c2b3d0556f1a tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1315 microversion: 2.1 time: 0.229788 May 25 15:41:58.533758 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 135/272] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:58 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:41:58.851269 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-399f83a4-f533-4bfa-86b0-f80b3b9ede5f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:58.852184 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-399f83a4-f533-4bfa-86b0-f80b3b9ede5f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:58.860489 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-399f83a4-f533-4bfa-86b0-f80b3b9ede5f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:58.860965 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-399f83a4-f533-4bfa-86b0-f80b3b9ede5f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:58.861760 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-399f83a4-f533-4bfa-86b0-f80b3b9ede5f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:58.862208 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-399f83a4-f533-4bfa-86b0-f80b3b9ede5f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:59.001978 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-399f83a4-f533-4bfa-86b0-f80b3b9ede5f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 28712 microversion: 2.1 time: 0.154925 May 25 15:41:59.007430 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 138/273] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:41:58 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 28712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:41:59.090086 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8cc71a64-e550-4d26-898f-4ef4dc29b927 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:59.090740 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8cc71a64-e550-4d26-898f-4ef4dc29b927 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:59.098858 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8cc71a64-e550-4d26-898f-4ef4dc29b927 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:59.099206 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8cc71a64-e550-4d26-898f-4ef4dc29b927 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:59.100145 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8cc71a64-e550-4d26-898f-4ef4dc29b927 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:59.100597 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8cc71a64-e550-4d26-898f-4ef4dc29b927 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:59.226729 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-85f97932-957c-423e-a488-104cdb90314e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:41:59.227753 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-85f97932-957c-423e-a488-104cdb90314e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:59.235991 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-85f97932-957c-423e-a488-104cdb90314e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:59.236460 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-85f97932-957c-423e-a488-104cdb90314e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:59.237913 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-85f97932-957c-423e-a488-104cdb90314e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:59.238370 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-85f97932-957c-423e-a488-104cdb90314e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:59.313265 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8cc71a64-e550-4d26-898f-4ef4dc29b927 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:59.321981 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8cc71a64-e550-4d26-898f-4ef4dc29b927 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1359 microversion: 2.1 time: 0.235793 May 25 15:41:59.322550 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 136/274] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:59 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:59.368124 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-85f97932-957c-423e-a488-104cdb90314e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 28745 microversion: 2.20 time: 0.146065 May 25 15:41:59.368739 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 139/275] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:41:59 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 28745 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:41:59.387877 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-271f5f5d-5d22-415e-9692-86b6d0903b0b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:59.388540 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-271f5f5d-5d22-415e-9692-86b6d0903b0b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:59.395957 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-271f5f5d-5d22-415e-9692-86b6d0903b0b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:59.396424 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-271f5f5d-5d22-415e-9692-86b6d0903b0b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:59.397204 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-271f5f5d-5d22-415e-9692-86b6d0903b0b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:59.397650 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-271f5f5d-5d22-415e-9692-86b6d0903b0b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:59.555191 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6c90f5a8-040a-4859-a36f-cd8062ffcc5f tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:41:59.555934 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6c90f5a8-040a-4859-a36f-cd8062ffcc5f tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:41:59.563885 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c90f5a8-040a-4859-a36f-cd8062ffcc5f tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:59.564364 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c90f5a8-040a-4859-a36f-cd8062ffcc5f tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:59.565379 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c90f5a8-040a-4859-a36f-cd8062ffcc5f tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:59.565827 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c90f5a8-040a-4859-a36f-cd8062ffcc5f tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:59.594546 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-271f5f5d-5d22-415e-9692-86b6d0903b0b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:59.603274 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-271f5f5d-5d22-415e-9692-86b6d0903b0b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.219383 May 25 15:41:59.603851 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 137/276] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:59 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:41:59.781195 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-6c90f5a8-040a-4859-a36f-cd8062ffcc5f tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:41:59.790027 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6c90f5a8-040a-4859-a36f-cd8062ffcc5f tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1315 microversion: 2.1 time: 0.239260 May 25 15:41:59.790592 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 140/277] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:41:59 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:00.014833 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-640ae19b-ce03-48ef-899a-cecbc47040e8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:00.016048 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-640ae19b-ce03-48ef-899a-cecbc47040e8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:00.024195 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-640ae19b-ce03-48ef-899a-cecbc47040e8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.024653 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-640ae19b-ce03-48ef-899a-cecbc47040e8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.025432 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-640ae19b-ce03-48ef-899a-cecbc47040e8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.025868 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-640ae19b-ce03-48ef-899a-cecbc47040e8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.147312 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-640ae19b-ce03-48ef-899a-cecbc47040e8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 28712 microversion: 2.1 time: 0.135725 May 25 15:42:00.148808 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 138/278] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:00 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 28712 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:42:00.340396 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d6247394-5339-4fae-95fc-208b2154a99c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:00.341346 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d6247394-5339-4fae-95fc-208b2154a99c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:00.350201 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d6247394-5339-4fae-95fc-208b2154a99c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.350879 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d6247394-5339-4fae-95fc-208b2154a99c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.351847 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d6247394-5339-4fae-95fc-208b2154a99c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.352508 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d6247394-5339-4fae-95fc-208b2154a99c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.382356 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a74f657c-9ba9-4435-ba0e-3f3964f78d75 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:00.383640 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a74f657c-9ba9-4435-ba0e-3f3964f78d75 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:00.392903 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a74f657c-9ba9-4435-ba0e-3f3964f78d75 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.394609 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a74f657c-9ba9-4435-ba0e-3f3964f78d75 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.395441 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a74f657c-9ba9-4435-ba0e-3f3964f78d75 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.396536 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a74f657c-9ba9-4435-ba0e-3f3964f78d75 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.572962 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a74f657c-9ba9-4435-ba0e-3f3964f78d75 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 28745 microversion: 2.20 time: 0.194707 May 25 15:42:00.575000 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 139/279] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:00 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 28745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:42:00.583892 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-3b9a741e-3df0-494e-9388-34bd77ea818d req-4a354ab7-2c41-43e9-8fe9-776924055386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e39efa-e568-41dd-9368-376ead8b1020", "name": "network-vif-plugged", "status": "completed", "tag": "c536b9e5-ae17-4775-b209-71e6ec42122a"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:00.586399 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:42:00.586399 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:42:00.606545 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-3b9a741e-3df0-494e-9388-34bd77ea818d req-4a354ab7-2c41-43e9-8fe9-776924055386 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.607000 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-3b9a741e-3df0-494e-9388-34bd77ea818d req-4a354ab7-2c41-43e9-8fe9-776924055386 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.616814 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d6247394-5339-4fae-95fc-208b2154a99c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:00.625797 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-3b9a741e-3df0-494e-9388-34bd77ea818d req-4a354ab7-2c41-43e9-8fe9-776924055386 service nova] Creating event network-vif-plugged:c536b9e5-ae17-4775-b209-71e6ec42122a for instance 17e39efa-e568-41dd-9368-376ead8b1020 on hv-cinder-79123 May 25 15:42:00.626367 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d6247394-5339-4fae-95fc-208b2154a99c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1359 microversion: 2.1 time: 0.289900 May 25 15:42:00.627026 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 141/280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:00 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1359 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:00.632675 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-346511bb-91a8-496c-972b-a9670c38c446 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:00.633643 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-346511bb-91a8-496c-972b-a9670c38c446 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:00.640943 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-3b9a741e-3df0-494e-9388-34bd77ea818d req-4a354ab7-2c41-43e9-8fe9-776924055386 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064130 May 25 15:42:00.641920 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 140/281] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:42:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:42:00.643014 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-346511bb-91a8-496c-972b-a9670c38c446 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.643567 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-346511bb-91a8-496c-972b-a9670c38c446 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.645184 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-346511bb-91a8-496c-972b-a9670c38c446 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.645343 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-346511bb-91a8-496c-972b-a9670c38c446 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.808651 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-cf895200-9b99-43d6-95e6-435b3dd0377c tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:00.809490 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-cf895200-9b99-43d6-95e6-435b3dd0377c tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:00.821445 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cf895200-9b99-43d6-95e6-435b3dd0377c tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.821922 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cf895200-9b99-43d6-95e6-435b3dd0377c tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.823386 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cf895200-9b99-43d6-95e6-435b3dd0377c tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.823835 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cf895200-9b99-43d6-95e6-435b3dd0377c tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.960612 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-346511bb-91a8-496c-972b-a9670c38c446 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:00.976982 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-346511bb-91a8-496c-972b-a9670c38c446 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.348856 May 25 15:42:00.992528 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 142/282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:00 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:01.104692 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-cf895200-9b99-43d6-95e6-435b3dd0377c tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:01.112929 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-cf895200-9b99-43d6-95e6-435b3dd0377c tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1315 microversion: 2.1 time: 0.309761 May 25 15:42:01.113502 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 141/283] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:00 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:01.158568 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ba8eefb2-c366-478d-8178-a27eb50b11e2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:01.160144 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ba8eefb2-c366-478d-8178-a27eb50b11e2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:01.167494 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ba8eefb2-c366-478d-8178-a27eb50b11e2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:01.168002 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ba8eefb2-c366-478d-8178-a27eb50b11e2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:01.168818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ba8eefb2-c366-478d-8178-a27eb50b11e2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:01.169299 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ba8eefb2-c366-478d-8178-a27eb50b11e2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:01.323295 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ba8eefb2-c366-478d-8178-a27eb50b11e2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 28712 microversion: 2.1 time: 0.168340 May 25 15:42:01.327024 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 143/284] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:01 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 28712 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:42:01.586061 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-25b826b8-0981-4d80-aad1-39ef161e0202 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:01.586906 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-25b826b8-0981-4d80-aad1-39ef161e0202 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:01.594281 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-25b826b8-0981-4d80-aad1-39ef161e0202 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:01.594738 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-25b826b8-0981-4d80-aad1-39ef161e0202 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:01.595556 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-25b826b8-0981-4d80-aad1-39ef161e0202 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:01.596307 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-25b826b8-0981-4d80-aad1-39ef161e0202 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:01.645271 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a4cab5c4-16e8-4ecc-9dc6-fcb7abde8ee8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:01.646103 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a4cab5c4-16e8-4ecc-9dc6-fcb7abde8ee8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:01.653838 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a4cab5c4-16e8-4ecc-9dc6-fcb7abde8ee8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:01.654300 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a4cab5c4-16e8-4ecc-9dc6-fcb7abde8ee8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:01.655079 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a4cab5c4-16e8-4ecc-9dc6-fcb7abde8ee8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:01.655516 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a4cab5c4-16e8-4ecc-9dc6-fcb7abde8ee8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:01.737842 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-25b826b8-0981-4d80-aad1-39ef161e0202 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 28745 microversion: 2.20 time: 0.154942 May 25 15:42:01.738544 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 142/285] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:01 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 28745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:01.858768 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a4cab5c4-16e8-4ecc-9dc6-fcb7abde8ee8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:01.867547 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a4cab5c4-16e8-4ecc-9dc6-fcb7abde8ee8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1359 microversion: 2.1 time: 0.227074 May 25 15:42:01.868157 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 144/286] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:01 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:02.019032 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1b0b3a49-af6a-4ee1-b6f7-24646372e23d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:02.019765 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1b0b3a49-af6a-4ee1-b6f7-24646372e23d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:02.027514 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1b0b3a49-af6a-4ee1-b6f7-24646372e23d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.028007 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1b0b3a49-af6a-4ee1-b6f7-24646372e23d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.028778 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1b0b3a49-af6a-4ee1-b6f7-24646372e23d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.029219 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1b0b3a49-af6a-4ee1-b6f7-24646372e23d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.129704 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-54384d6c-b363-44d5-a6e6-4ba816af1e11 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:02.130258 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-54384d6c-b363-44d5-a6e6-4ba816af1e11 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:02.138008 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-54384d6c-b363-44d5-a6e6-4ba816af1e11 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.138489 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-54384d6c-b363-44d5-a6e6-4ba816af1e11 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.139287 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-54384d6c-b363-44d5-a6e6-4ba816af1e11 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.139737 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-54384d6c-b363-44d5-a6e6-4ba816af1e11 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.258180 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1b0b3a49-af6a-4ee1-b6f7-24646372e23d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:02.267999 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1b0b3a49-af6a-4ee1-b6f7-24646372e23d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.253126 May 25 15:42:02.268592 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 143/287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:02 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:02.334510 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-273b27c6-9e3f-4fd4-ba4e-21acb465b1f9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:02.335415 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-273b27c6-9e3f-4fd4-ba4e-21acb465b1f9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:02.342740 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-273b27c6-9e3f-4fd4-ba4e-21acb465b1f9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.343198 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-273b27c6-9e3f-4fd4-ba4e-21acb465b1f9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.344009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-273b27c6-9e3f-4fd4-ba4e-21acb465b1f9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.344458 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-273b27c6-9e3f-4fd4-ba4e-21acb465b1f9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.390216 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-54384d6c-b363-44d5-a6e6-4ba816af1e11 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:02.398702 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-54384d6c-b363-44d5-a6e6-4ba816af1e11 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1315 microversion: 2.1 time: 0.273471 May 25 15:42:02.399383 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 145/288] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:02 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:02.478818 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-273b27c6-9e3f-4fd4-ba4e-21acb465b1f9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 28712 microversion: 2.1 time: 0.147895 May 25 15:42:02.479470 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 144/289] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:02 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 28712 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:42:02.749347 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-42bcc203-ff47-42e5-85b8-12abfc038a52 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:02.750324 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-42bcc203-ff47-42e5-85b8-12abfc038a52 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:02.758303 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-42bcc203-ff47-42e5-85b8-12abfc038a52 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.758760 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-42bcc203-ff47-42e5-85b8-12abfc038a52 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.759541 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-42bcc203-ff47-42e5-85b8-12abfc038a52 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.760265 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-42bcc203-ff47-42e5-85b8-12abfc038a52 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.884347 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6ec92eaf-d89b-4bc2-8149-d2a44f950bc6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:02.885354 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6ec92eaf-d89b-4bc2-8149-d2a44f950bc6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:02.893226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ec92eaf-d89b-4bc2-8149-d2a44f950bc6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.894259 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ec92eaf-d89b-4bc2-8149-d2a44f950bc6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.895035 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ec92eaf-d89b-4bc2-8149-d2a44f950bc6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:02.895480 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ec92eaf-d89b-4bc2-8149-d2a44f950bc6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:02.908946 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-42bcc203-ff47-42e5-85b8-12abfc038a52 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 28745 microversion: 2.20 time: 0.163138 May 25 15:42:02.909979 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 146/290] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:02 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 28745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:03.090216 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6ec92eaf-d89b-4bc2-8149-d2a44f950bc6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:03.099011 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6ec92eaf-d89b-4bc2-8149-d2a44f950bc6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1549 microversion: 2.1 time: 0.218746 May 25 15:42:03.099583 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 145/291] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:02 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1549 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:03.116498 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-db7a1474-5c71-493c-9142-e390fe74a222 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:03.117251 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-db7a1474-5c71-493c-9142-e390fe74a222 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:03.126451 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-db7a1474-5c71-493c-9142-e390fe74a222 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.126952 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-db7a1474-5c71-493c-9142-e390fe74a222 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.128350 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-db7a1474-5c71-493c-9142-e390fe74a222 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.128851 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-db7a1474-5c71-493c-9142-e390fe74a222 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.286104 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3ebb8008-cc2a-4ef1-9ec9-42d42a084f2c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:03.286733 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-3ebb8008-cc2a-4ef1-9ec9-42d42a084f2c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:03.294233 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3ebb8008-cc2a-4ef1-9ec9-42d42a084f2c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.294622 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3ebb8008-cc2a-4ef1-9ec9-42d42a084f2c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.295410 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3ebb8008-cc2a-4ef1-9ec9-42d42a084f2c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.295854 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3ebb8008-cc2a-4ef1-9ec9-42d42a084f2c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.330749 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-db7a1474-5c71-493c-9142-e390fe74a222 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:03.340208 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-db7a1474-5c71-493c-9142-e390fe74a222 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1549 microversion: 2.1 time: 0.228584 May 25 15:42:03.340890 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 147/292] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:03 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:03.355088 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0292b1d3-5933-48a6-836d-52e2994647b2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:03.359015 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:42:03.359015 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:42:03.360467 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0292b1d3-5933-48a6-836d-52e2994647b2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:03.361481 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0292b1d3-5933-48a6-836d-52e2994647b2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Searching by: {'deleted': False, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6'} {{(pid=112577) get_all /opt/stack/nova/nova/compute/api.py:2832}} May 25 15:42:03.368345 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0292b1d3-5933-48a6-836d-52e2994647b2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.368807 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0292b1d3-5933-48a6-836d-52e2994647b2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.369624 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0292b1d3-5933-48a6-836d-52e2994647b2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.370067 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0292b1d3-5933-48a6-836d-52e2994647b2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.472769 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.multi_cell_list [None req-0292b1d3-5933-48a6-836d-52e2994647b2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=112577) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} May 25 15:42:03.503973 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3ebb8008-cc2a-4ef1-9ec9-42d42a084f2c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:03.512657 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3ebb8008-cc2a-4ef1-9ec9-42d42a084f2c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.230326 May 25 15:42:03.522145 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 146/293] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:03 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:03.525994 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f12263ec-1416-4235-9012-f0d42eb442e8 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:03.526621 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f12263ec-1416-4235-9012-f0d42eb442e8 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:03.533639 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f12263ec-1416-4235-9012-f0d42eb442e8 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.534126 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f12263ec-1416-4235-9012-f0d42eb442e8 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.534900 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f12263ec-1416-4235-9012-f0d42eb442e8 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.535337 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f12263ec-1416-4235-9012-f0d42eb442e8 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.572797 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0292b1d3-5933-48a6-836d-52e2994647b2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.220979 May 25 15:42:03.573516 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 148/294] 10.222.0.36 () {58 vars in 1125 bytes} [Tue May 25 15:42:03 2021] GET /compute/v2.1/servers => generated 343 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:42:03.578038 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ba6fa56c-dd52-4cc8-bb2d-656713b29e72 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:03.579901 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ba6fa56c-dd52-4cc8-bb2d-656713b29e72 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:03.588849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ba6fa56c-dd52-4cc8-bb2d-656713b29e72 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.590591 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ba6fa56c-dd52-4cc8-bb2d-656713b29e72 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.599883 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ba6fa56c-dd52-4cc8-bb2d-656713b29e72 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.599883 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ba6fa56c-dd52-4cc8-bb2d-656713b29e72 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.733397 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ba6fa56c-dd52-4cc8-bb2d-656713b29e72 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 29432 microversion: 2.1 time: 0.158787 May 25 15:42:03.737909 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 149/295] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:03 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 29432 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:42:03.739712 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9201ab4a-1cd0-41d3-88ba-c669f18b688b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:03.740469 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9201ab4a-1cd0-41d3-88ba-c669f18b688b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:03.748441 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9201ab4a-1cd0-41d3-88ba-c669f18b688b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.748908 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9201ab4a-1cd0-41d3-88ba-c669f18b688b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.749700 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9201ab4a-1cd0-41d3-88ba-c669f18b688b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.750241 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9201ab4a-1cd0-41d3-88ba-c669f18b688b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.804300 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f12263ec-1416-4235-9012-f0d42eb442e8 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:03.813903 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f12263ec-1416-4235-9012-f0d42eb442e8 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1315 microversion: 2.1 time: 0.299111 May 25 15:42:03.814300 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 147/296] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:03 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:03.921021 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5259745e-9167-4ec5-a934-2f4cc81d7725 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:03.921944 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5259745e-9167-4ec5-a934-2f4cc81d7725 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:03.929863 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5259745e-9167-4ec5-a934-2f4cc81d7725 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.930326 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5259745e-9167-4ec5-a934-2f4cc81d7725 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:03.931122 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5259745e-9167-4ec5-a934-2f4cc81d7725 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:03.931575 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5259745e-9167-4ec5-a934-2f4cc81d7725 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:04.020055 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9201ab4a-1cd0-41d3-88ba-c669f18b688b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:04.028681 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9201ab4a-1cd0-41d3-88ba-c669f18b688b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1549 microversion: 2.1 time: 0.293322 May 25 15:42:04.029255 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 150/297] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:03 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1549 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:04.088825 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5259745e-9167-4ec5-a934-2f4cc81d7725 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 29297 microversion: 2.20 time: 0.171410 May 25 15:42:04.093042 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 148/298] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:03 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 29297 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:42:04.248882 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-6bcec8e2-a785-42d7-bb1e-1f274cfe8872 req-2e46e5b6-1663-4517-bec5-ac43863cb5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cefa816-94bd-4b6c-ba1e-c71f7b539bf3", "name": "network-vif-plugged", "status": "completed", "tag": "0d049ba8-f49c-4e51-b70c-b3c7bcb786d5"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:04.250596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:42:04.250596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:42:04.260945 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-6bcec8e2-a785-42d7-bb1e-1f274cfe8872 req-2e46e5b6-1663-4517-bec5-ac43863cb5e2 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:04.261969 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-6bcec8e2-a785-42d7-bb1e-1f274cfe8872 req-2e46e5b6-1663-4517-bec5-ac43863cb5e2 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:04.279280 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-6bcec8e2-a785-42d7-bb1e-1f274cfe8872 req-2e46e5b6-1663-4517-bec5-ac43863cb5e2 service nova] Creating event network-vif-plugged:0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 for instance 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 on hv-cinder-79123 May 25 15:42:04.285245 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-6bcec8e2-a785-42d7-bb1e-1f274cfe8872 req-2e46e5b6-1663-4517-bec5-ac43863cb5e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040837 May 25 15:42:04.285852 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 151/299] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:42:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:42:04.530856 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-903d0df3-e258-4ef7-80e3-97ccd9613263 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:04.531784 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-903d0df3-e258-4ef7-80e3-97ccd9613263 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:04.541954 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-903d0df3-e258-4ef7-80e3-97ccd9613263 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:04.542656 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-903d0df3-e258-4ef7-80e3-97ccd9613263 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:04.543633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-903d0df3-e258-4ef7-80e3-97ccd9613263 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:04.544267 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-903d0df3-e258-4ef7-80e3-97ccd9613263 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:04.743182 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-903d0df3-e258-4ef7-80e3-97ccd9613263 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:04.745842 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b880c4ef-11df-4f48-8f88-2d080d9e79cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:04.746866 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b880c4ef-11df-4f48-8f88-2d080d9e79cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:04.751512 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-903d0df3-e258-4ef7-80e3-97ccd9613263 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.225359 May 25 15:42:04.752125 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 149/300] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:04 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:04.754842 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b880c4ef-11df-4f48-8f88-2d080d9e79cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:04.755294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b880c4ef-11df-4f48-8f88-2d080d9e79cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:04.756110 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b880c4ef-11df-4f48-8f88-2d080d9e79cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:04.756555 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b880c4ef-11df-4f48-8f88-2d080d9e79cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:04.830396 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b0d8d401-beb9-41c4-a6b3-ad87a6b4d67e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:04.831524 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b0d8d401-beb9-41c4-a6b3-ad87a6b4d67e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:04.838832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b0d8d401-beb9-41c4-a6b3-ad87a6b4d67e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:04.839293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b0d8d401-beb9-41c4-a6b3-ad87a6b4d67e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:04.840139 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b0d8d401-beb9-41c4-a6b3-ad87a6b4d67e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:04.840591 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b0d8d401-beb9-41c4-a6b3-ad87a6b4d67e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:04.896835 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b880c4ef-11df-4f48-8f88-2d080d9e79cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 30263 microversion: 2.1 time: 0.154931 May 25 15:42:04.897649 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 152/301] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:04 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 30263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:42:05.039049 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b0d8d401-beb9-41c4-a6b3-ad87a6b4d67e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:05.047356 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b0d8d401-beb9-41c4-a6b3-ad87a6b4d67e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1315 microversion: 2.1 time: 0.220738 May 25 15:42:05.048040 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 150/302] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:04 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:05.102907 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-233032ce-9d9e-4981-be4f-774c724b49fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:05.103946 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-233032ce-9d9e-4981-be4f-774c724b49fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:05.112038 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-233032ce-9d9e-4981-be4f-774c724b49fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:05.112563 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-233032ce-9d9e-4981-be4f-774c724b49fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:05.113399 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-233032ce-9d9e-4981-be4f-774c724b49fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:05.113979 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-233032ce-9d9e-4981-be4f-774c724b49fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:05.252003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-233032ce-9d9e-4981-be4f-774c724b49fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 30143 microversion: 2.20 time: 0.153539 May 25 15:42:05.253352 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 153/303] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:05 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 30143 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:05.768498 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ec14209c-ab57-46d7-833f-0db4e86ce0f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:05.769209 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ec14209c-ab57-46d7-833f-0db4e86ce0f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:05.777325 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ec14209c-ab57-46d7-833f-0db4e86ce0f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:05.777867 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ec14209c-ab57-46d7-833f-0db4e86ce0f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:05.778728 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ec14209c-ab57-46d7-833f-0db4e86ce0f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:05.779246 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ec14209c-ab57-46d7-833f-0db4e86ce0f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:05.911506 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c2635156-a4d2-4fd0-b376-55d2b8d0cec7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:05.913168 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c2635156-a4d2-4fd0-b376-55d2b8d0cec7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:05.924321 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c2635156-a4d2-4fd0-b376-55d2b8d0cec7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:05.925380 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c2635156-a4d2-4fd0-b376-55d2b8d0cec7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:05.926343 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c2635156-a4d2-4fd0-b376-55d2b8d0cec7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:05.926788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c2635156-a4d2-4fd0-b376-55d2b8d0cec7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:05.989685 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ec14209c-ab57-46d7-833f-0db4e86ce0f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:06.002732 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ec14209c-ab57-46d7-833f-0db4e86ce0f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.237814 May 25 15:42:06.003328 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 151/304] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:05 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:06.008199 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6b63ae7c-15ad-40a0-a818-35c7af329aa7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1aca56f5-465c-4ca6-9bc1-aa69b76f3bee"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:06.009483 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6b63ae7c-15ad-40a0-a818-35c7af329aa7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:06.017105 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b63ae7c-15ad-40a0-a818-35c7af329aa7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:06.017561 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b63ae7c-15ad-40a0-a818-35c7af329aa7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:06.018375 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b63ae7c-15ad-40a0-a818-35c7af329aa7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:06.018846 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b63ae7c-15ad-40a0-a818-35c7af329aa7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:06.114377 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c2635156-a4d2-4fd0-b376-55d2b8d0cec7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 30902 microversion: 2.1 time: 0.208944 May 25 15:42:06.115330 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 154/305] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:05 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 30902 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:42:06.121183 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1ff7e873-decd-4aa9-b4a7-ced0eb8bc9ef tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:06.121974 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1ff7e873-decd-4aa9-b4a7-ced0eb8bc9ef tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:06.130095 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1ff7e873-decd-4aa9-b4a7-ced0eb8bc9ef tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:06.130640 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1ff7e873-decd-4aa9-b4a7-ced0eb8bc9ef tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:06.131522 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1ff7e873-decd-4aa9-b4a7-ced0eb8bc9ef tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:06.132100 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1ff7e873-decd-4aa9-b4a7-ced0eb8bc9ef tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:06.444984 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6b63ae7c-15ad-40a0-a818-35c7af329aa7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440169 May 25 15:42:06.445724 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 152/306] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:42:06 2021] POST /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:42:06.451281 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-af573125-1f2f-40aa-960a-cc44dda235d6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:06.452731 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-af573125-1f2f-40aa-960a-cc44dda235d6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:06.461762 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-af573125-1f2f-40aa-960a-cc44dda235d6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:06.462412 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-af573125-1f2f-40aa-960a-cc44dda235d6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:06.463200 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-af573125-1f2f-40aa-960a-cc44dda235d6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:06.463819 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-af573125-1f2f-40aa-960a-cc44dda235d6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:06.501229 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1ff7e873-decd-4aa9-b4a7-ced0eb8bc9ef tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:06.529255 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1ff7e873-decd-4aa9-b4a7-ced0eb8bc9ef tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1315 microversion: 2.1 time: 0.412346 May 25 15:42:06.530047 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 155/307] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:06 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:06.630043 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-af573125-1f2f-40aa-960a-cc44dda235d6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 30855 microversion: 2.20 time: 0.182578 May 25 15:42:06.631309 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 153/308] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:06 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 30855 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:07.020509 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-035f3e84-f83d-41cc-9b9e-5a3047afd420 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:07.021136 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-035f3e84-f83d-41cc-9b9e-5a3047afd420 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:07.028547 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-035f3e84-f83d-41cc-9b9e-5a3047afd420 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.029012 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-035f3e84-f83d-41cc-9b9e-5a3047afd420 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.029794 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-035f3e84-f83d-41cc-9b9e-5a3047afd420 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.030241 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-035f3e84-f83d-41cc-9b9e-5a3047afd420 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.127199 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-383e0bad-6006-4fa4-b545-ab20151001fa tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:07.128434 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-383e0bad-6006-4fa4-b545-ab20151001fa tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:07.136678 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-383e0bad-6006-4fa4-b545-ab20151001fa tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.137236 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-383e0bad-6006-4fa4-b545-ab20151001fa tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.138085 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-383e0bad-6006-4fa4-b545-ab20151001fa tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.138594 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-383e0bad-6006-4fa4-b545-ab20151001fa tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.226081 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-035f3e84-f83d-41cc-9b9e-5a3047afd420 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:07.234272 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-035f3e84-f83d-41cc-9b9e-5a3047afd420 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.218188 May 25 15:42:07.234845 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 156/309] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:07 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:07.277582 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-383e0bad-6006-4fa4-b545-ab20151001fa tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 31662 microversion: 2.1 time: 0.154398 May 25 15:42:07.278226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 154/310] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:07 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 31662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:42:07.546569 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-320576fb-95f4-4ae9-8834-0bbbc1d89f04 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:07.547200 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-320576fb-95f4-4ae9-8834-0bbbc1d89f04 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:07.554602 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-320576fb-95f4-4ae9-8834-0bbbc1d89f04 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.555066 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-320576fb-95f4-4ae9-8834-0bbbc1d89f04 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.555875 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-320576fb-95f4-4ae9-8834-0bbbc1d89f04 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.556326 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-320576fb-95f4-4ae9-8834-0bbbc1d89f04 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.642524 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-65eeea00-aeaa-4c68-8e94-3424c96d58f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:07.643550 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-65eeea00-aeaa-4c68-8e94-3424c96d58f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:07.651782 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-65eeea00-aeaa-4c68-8e94-3424c96d58f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.652271 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-65eeea00-aeaa-4c68-8e94-3424c96d58f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.653107 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-65eeea00-aeaa-4c68-8e94-3424c96d58f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.653508 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-65eeea00-aeaa-4c68-8e94-3424c96d58f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.775253 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-320576fb-95f4-4ae9-8834-0bbbc1d89f04 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:07.783436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-320576fb-95f4-4ae9-8834-0bbbc1d89f04 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1464 microversion: 2.1 time: 0.240608 May 25 15:42:07.784038 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 157/311] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:07 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1464 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:07.785188 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-65eeea00-aeaa-4c68-8e94-3424c96d58f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 31654 microversion: 2.20 time: 0.146660 May 25 15:42:07.785997 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 155/312] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:07 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 31654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:42:07.851450 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2f55425f-a533-4aaf-aa73-4c95d4cc270b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:07.851988 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2f55425f-a533-4aaf-aa73-4c95d4cc270b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:07.859281 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f55425f-a533-4aaf-aa73-4c95d4cc270b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.859745 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f55425f-a533-4aaf-aa73-4c95d4cc270b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.860565 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f55425f-a533-4aaf-aa73-4c95d4cc270b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:07.861010 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f55425f-a533-4aaf-aa73-4c95d4cc270b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:07.936940 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2f55425f-a533-4aaf-aa73-4c95d4cc270b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Going to try to terminate instance {{(pid=112577) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:42:08.046565 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2f55425f-a533-4aaf-aa73-4c95d4cc270b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 204 len: 0 microversion: 2.1 time: 0.198328 May 25 15:42:08.047243 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 158/313] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:42:07 2021] DELETE /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:42:08.057249 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bf44e5dc-6e2b-4911-8203-3cca29adad57 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:08.057968 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bf44e5dc-6e2b-4911-8203-3cca29adad57 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:08.065988 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bf44e5dc-6e2b-4911-8203-3cca29adad57 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:08.066444 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bf44e5dc-6e2b-4911-8203-3cca29adad57 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:08.067842 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bf44e5dc-6e2b-4911-8203-3cca29adad57 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:08.068307 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bf44e5dc-6e2b-4911-8203-3cca29adad57 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:08.252109 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-52537bc0-3288-4d68-8d4c-71026a49b7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:08.252825 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-52537bc0-3288-4d68-8d4c-71026a49b7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:08.260985 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-52537bc0-3288-4d68-8d4c-71026a49b7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:08.261466 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-52537bc0-3288-4d68-8d4c-71026a49b7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:08.262285 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-52537bc0-3288-4d68-8d4c-71026a49b7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:08.262753 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-52537bc0-3288-4d68-8d4c-71026a49b7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:08.270388 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-bf44e5dc-6e2b-4911-8203-3cca29adad57 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:08.278832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bf44e5dc-6e2b-4911-8203-3cca29adad57 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1470 microversion: 2.1 time: 0.226069 May 25 15:42:08.279405 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 156/314] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:08 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:08.289541 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-047d2629-7670-4186-a355-78cfa6c180cb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:08.290540 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-047d2629-7670-4186-a355-78cfa6c180cb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:08.297916 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-047d2629-7670-4186-a355-78cfa6c180cb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:08.298453 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-047d2629-7670-4186-a355-78cfa6c180cb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:08.299305 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-047d2629-7670-4186-a355-78cfa6c180cb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:08.299821 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-047d2629-7670-4186-a355-78cfa6c180cb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:08.446263 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-047d2629-7670-4186-a355-78cfa6c180cb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 32120 microversion: 2.1 time: 0.160481 May 25 15:42:08.447554 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 157/315] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:08 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 32120 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:42:08.460804 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-52537bc0-3288-4d68-8d4c-71026a49b7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:08.469072 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-52537bc0-3288-4d68-8d4c-71026a49b7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.221137 May 25 15:42:08.469642 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 159/316] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:08 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:08.797331 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f099cdaf-cd24-4105-8ece-ae977a9bfad8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:08.798334 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f099cdaf-cd24-4105-8ece-ae977a9bfad8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:08.806216 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f099cdaf-cd24-4105-8ece-ae977a9bfad8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:08.806682 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f099cdaf-cd24-4105-8ece-ae977a9bfad8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:08.807463 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f099cdaf-cd24-4105-8ece-ae977a9bfad8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:08.807940 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f099cdaf-cd24-4105-8ece-ae977a9bfad8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:08.944949 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f099cdaf-cd24-4105-8ece-ae977a9bfad8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 32574 microversion: 2.20 time: 0.151903 May 25 15:42:08.945582 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 158/317] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:08 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 32574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:09.296242 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a31bf896-2764-47c2-9cbd-17a6aeb7c75e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:09.296864 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a31bf896-2764-47c2-9cbd-17a6aeb7c75e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:09.305646 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a31bf896-2764-47c2-9cbd-17a6aeb7c75e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:09.306100 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a31bf896-2764-47c2-9cbd-17a6aeb7c75e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:09.306872 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a31bf896-2764-47c2-9cbd-17a6aeb7c75e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:09.307309 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a31bf896-2764-47c2-9cbd-17a6aeb7c75e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:09.459401 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ae6bf1c6-4a80-47e6-b109-ee172dbdc590 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:09.460518 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ae6bf1c6-4a80-47e6-b109-ee172dbdc590 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:09.468555 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ae6bf1c6-4a80-47e6-b109-ee172dbdc590 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:09.469028 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ae6bf1c6-4a80-47e6-b109-ee172dbdc590 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:09.469853 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ae6bf1c6-4a80-47e6-b109-ee172dbdc590 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:09.470302 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ae6bf1c6-4a80-47e6-b109-ee172dbdc590 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:09.508167 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a31bf896-2764-47c2-9cbd-17a6aeb7c75e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:09.516669 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a31bf896-2764-47c2-9cbd-17a6aeb7c75e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1470 microversion: 2.1 time: 0.224142 May 25 15:42:09.517246 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 160/318] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:09 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1470 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:09.524764 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3cb30f65-6037-4a5e-9d09-4bff62252a31 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:09.525736 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3cb30f65-6037-4a5e-9d09-4bff62252a31 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:09.533168 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3cb30f65-6037-4a5e-9d09-4bff62252a31 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:09.533619 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3cb30f65-6037-4a5e-9d09-4bff62252a31 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:09.534408 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3cb30f65-6037-4a5e-9d09-4bff62252a31 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:09.534846 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3cb30f65-6037-4a5e-9d09-4bff62252a31 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:09.595137 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ae6bf1c6-4a80-47e6-b109-ee172dbdc590 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 32458 microversion: 2.1 time: 0.139709 May 25 15:42:09.596839 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 159/319] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:09 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 32458 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:42:09.733478 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3cb30f65-6037-4a5e-9d09-4bff62252a31 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:09.742074 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3cb30f65-6037-4a5e-9d09-4bff62252a31 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.220703 May 25 15:42:09.742662 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 161/320] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:09 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:09.957927 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3913e282-ed8a-4215-a2d0-68e2f08628e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:09.958956 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-3913e282-ed8a-4215-a2d0-68e2f08628e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:09.966944 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3913e282-ed8a-4215-a2d0-68e2f08628e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:09.967398 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3913e282-ed8a-4215-a2d0-68e2f08628e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:09.968206 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3913e282-ed8a-4215-a2d0-68e2f08628e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:09.968712 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3913e282-ed8a-4215-a2d0-68e2f08628e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:10.105768 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3913e282-ed8a-4215-a2d0-68e2f08628e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 33040 microversion: 2.20 time: 0.152284 May 25 15:42:10.109902 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 160/321] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:09 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 33040 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:10.533739 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0a49ce33-0491-4229-afb0-7c7dd6a055a4 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:10.534397 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0a49ce33-0491-4229-afb0-7c7dd6a055a4 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:10.542580 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0a49ce33-0491-4229-afb0-7c7dd6a055a4 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:10.543088 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0a49ce33-0491-4229-afb0-7c7dd6a055a4 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:10.544203 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0a49ce33-0491-4229-afb0-7c7dd6a055a4 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:10.544793 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0a49ce33-0491-4229-afb0-7c7dd6a055a4 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:10.608200 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-51a79941-a9a0-4171-bff7-411834988a54 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:10.609215 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-51a79941-a9a0-4171-bff7-411834988a54 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:10.617159 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-51a79941-a9a0-4171-bff7-411834988a54 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:10.617616 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-51a79941-a9a0-4171-bff7-411834988a54 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:10.618402 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-51a79941-a9a0-4171-bff7-411834988a54 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:10.618888 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-51a79941-a9a0-4171-bff7-411834988a54 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:10.744659 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0a49ce33-0491-4229-afb0-7c7dd6a055a4 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:10.753182 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0a49ce33-0491-4229-afb0-7c7dd6a055a4 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1470 microversion: 2.1 time: 0.223462 May 25 15:42:10.753851 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 162/322] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:10 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1470 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:10.759095 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-772b849a-c88c-44ae-b46d-4bf9c0035d8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:10.759727 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-772b849a-c88c-44ae-b46d-4bf9c0035d8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:10.767183 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-772b849a-c88c-44ae-b46d-4bf9c0035d8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:10.767642 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-772b849a-c88c-44ae-b46d-4bf9c0035d8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:10.768453 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-772b849a-c88c-44ae-b46d-4bf9c0035d8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:10.768892 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-772b849a-c88c-44ae-b46d-4bf9c0035d8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:10.779040 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-51a79941-a9a0-4171-bff7-411834988a54 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 32898 microversion: 2.1 time: 0.174852 May 25 15:42:10.779972 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 161/323] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:10 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 32898 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:42:11.118920 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-33992bf5-7d4c-4d0d-9dbb-3fe83128f7f2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:11.120093 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-33992bf5-7d4c-4d0d-9dbb-3fe83128f7f2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:11.128720 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-33992bf5-7d4c-4d0d-9dbb-3fe83128f7f2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:11.129573 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-33992bf5-7d4c-4d0d-9dbb-3fe83128f7f2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:11.130781 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-33992bf5-7d4c-4d0d-9dbb-3fe83128f7f2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:11.132083 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-33992bf5-7d4c-4d0d-9dbb-3fe83128f7f2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:11.172581 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-772b849a-c88c-44ae-b46d-4bf9c0035d8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:11.184485 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-772b849a-c88c-44ae-b46d-4bf9c0035d8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.428784 May 25 15:42:11.186901 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 163/324] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:10 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:11.274082 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-33992bf5-7d4c-4d0d-9dbb-3fe83128f7f2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 33419 microversion: 2.20 time: 0.159107 May 25 15:42:11.278042 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 162/325] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:11 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 33419 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:42:11.770784 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-bf97b8f2-368f-4a7f-a44b-360c30ce6284 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:11.772544 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-bf97b8f2-368f-4a7f-a44b-360c30ce6284 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:11.783086 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-62cf5588-4b34-4c4c-9341-cec6e7b0415a req-b11be49f-3b24-4dc6-a94e-3053938a7425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cefa816-94bd-4b6c-ba1e-c71f7b539bf3", "name": "network-vif-deleted", "tag": "0d049ba8-f49c-4e51-b70c-b3c7bcb786d5"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:11.785275 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:42:11.785275 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:42:11.791947 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bf97b8f2-368f-4a7f-a44b-360c30ce6284 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:11.792918 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bf97b8f2-368f-4a7f-a44b-360c30ce6284 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:11.794019 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bf97b8f2-368f-4a7f-a44b-360c30ce6284 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:11.794881 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bf97b8f2-368f-4a7f-a44b-360c30ce6284 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:11.797694 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-62cf5588-4b34-4c4c-9341-cec6e7b0415a req-b11be49f-3b24-4dc6-a94e-3053938a7425 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:11.798157 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-62cf5588-4b34-4c4c-9341-cec6e7b0415a req-b11be49f-3b24-4dc6-a94e-3053938a7425 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:11.842801 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-62cf5588-4b34-4c4c-9341-cec6e7b0415a req-b11be49f-3b24-4dc6-a94e-3053938a7425 service nova] Creating event network-vif-deleted:0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 for instance 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 on hv-cinder-79123 May 25 15:42:11.850074 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-62cf5588-4b34-4c4c-9341-cec6e7b0415a req-b11be49f-3b24-4dc6-a94e-3053938a7425 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072296 May 25 15:42:11.850907 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 163/326] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:42:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:42:11.858047 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a8ab30c6-f554-4d27-b494-3aecd520e4b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:11.860216 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a8ab30c6-f554-4d27-b494-3aecd520e4b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:11.869983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a8ab30c6-f554-4d27-b494-3aecd520e4b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:11.870447 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a8ab30c6-f554-4d27-b494-3aecd520e4b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:11.871234 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a8ab30c6-f554-4d27-b494-3aecd520e4b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:11.871676 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a8ab30c6-f554-4d27-b494-3aecd520e4b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:11.957134 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-bf97b8f2-368f-4a7f-a44b-360c30ce6284 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017b1d106d0840e185adfa07aa95af62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5fb171d503440e86a06009ac0dceef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:11.966617 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-bf97b8f2-368f-4a7f-a44b-360c30ce6284 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 200 len: 1428 microversion: 2.1 time: 0.199796 May 25 15:42:11.967631 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 164/327] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:11 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 1428 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:12.004917 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a8ab30c6-f554-4d27-b494-3aecd520e4b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 33365 microversion: 2.1 time: 0.150834 May 25 15:42:12.005574 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 164/328] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:11 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 33365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:42:12.202310 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1d27355e-1e77-48a6-8c76-059ee38eb647 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:12.202851 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1d27355e-1e77-48a6-8c76-059ee38eb647 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:12.210628 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1d27355e-1e77-48a6-8c76-059ee38eb647 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:12.211111 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1d27355e-1e77-48a6-8c76-059ee38eb647 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:12.211892 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1d27355e-1e77-48a6-8c76-059ee38eb647 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:12.212328 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1d27355e-1e77-48a6-8c76-059ee38eb647 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:12.286537 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9efc05bc-87ea-4b13-99a3-dae331530e77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:12.287663 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9efc05bc-87ea-4b13-99a3-dae331530e77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:12.295584 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9efc05bc-87ea-4b13-99a3-dae331530e77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:12.296149 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9efc05bc-87ea-4b13-99a3-dae331530e77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:12.297005 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9efc05bc-87ea-4b13-99a3-dae331530e77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:12.297614 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9efc05bc-87ea-4b13-99a3-dae331530e77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:12.417157 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1d27355e-1e77-48a6-8c76-059ee38eb647 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:12.425669 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1d27355e-1e77-48a6-8c76-059ee38eb647 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.227134 May 25 15:42:12.426286 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 165/329] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:12 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:12.439691 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9efc05bc-87ea-4b13-99a3-dae331530e77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 33777 microversion: 2.20 time: 0.157280 May 25 15:42:12.440367 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 165/330] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:12 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 33777 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:42:12.984275 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-16a3fd29-7ac1-4cb4-ad4c-d006da4480e0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:12.984932 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-16a3fd29-7ac1-4cb4-ad4c-d006da4480e0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] [instance: 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:12.992328 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-16a3fd29-7ac1-4cb4-ad4c-d006da4480e0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:12.992788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-16a3fd29-7ac1-4cb4-ad4c-d006da4480e0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:12.993567 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-16a3fd29-7ac1-4cb4-ad4c-d006da4480e0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:12.994019 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-16a3fd29-7ac1-4cb4-ad4c-d006da4480e0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:13.016744 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9652b01e-8637-48e4-9e1e-d3081cdeb105 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:13.017755 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9652b01e-8637-48e4-9e1e-d3081cdeb105 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:13.026289 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9652b01e-8637-48e4-9e1e-d3081cdeb105 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:13.026745 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9652b01e-8637-48e4-9e1e-d3081cdeb105 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:13.027531 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9652b01e-8637-48e4-9e1e-d3081cdeb105 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:13.028001 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9652b01e-8637-48e4-9e1e-d3081cdeb105 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:13.046695 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-16a3fd29-7ac1-4cb4-ad4c-d006da4480e0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] HTTP exception thrown: Instance 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 could not be found. May 25 15:42:13.047316 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-16a3fd29-7ac1-4cb4-ad4c-d006da4480e0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Returning 404 to user: Instance 9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:42:13.048648 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-16a3fd29-7ac1-4cb4-ad4c-d006da4480e0 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3" status: 404 len: 111 microversion: 2.1 time: 0.068174 May 25 15:42:13.049218 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 166/331] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:12 2021] GET /compute/v2.1/servers/9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:42:13.158185 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9652b01e-8637-48e4-9e1e-d3081cdeb105 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 33750 microversion: 2.1 time: 0.143008 May 25 15:42:13.158185 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 166/332] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:13 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 33750 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:42:13.443517 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-26b6b859-55d3-4cfd-b96c-c831f750478f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:13.444204 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-26b6b859-55d3-4cfd-b96c-c831f750478f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:13.452363 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-26b6b859-55d3-4cfd-b96c-c831f750478f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:13.452834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-26b6b859-55d3-4cfd-b96c-c831f750478f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:13.453605 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-26b6b859-55d3-4cfd-b96c-c831f750478f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:13.454043 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-26b6b859-55d3-4cfd-b96c-c831f750478f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:13.455366 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-91cabf07-ee2f-4e4b-8191-d1314ed1e545 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:13.456430 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-91cabf07-ee2f-4e4b-8191-d1314ed1e545 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:13.465232 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-91cabf07-ee2f-4e4b-8191-d1314ed1e545 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:13.465802 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-91cabf07-ee2f-4e4b-8191-d1314ed1e545 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:13.466606 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-91cabf07-ee2f-4e4b-8191-d1314ed1e545 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:13.468115 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-91cabf07-ee2f-4e4b-8191-d1314ed1e545 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:13.674700 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-26b6b859-55d3-4cfd-b96c-c831f750478f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:13.684889 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-26b6b859-55d3-4cfd-b96c-c831f750478f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.245139 May 25 15:42:13.685929 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 167/333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:13 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:13.742205 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-91cabf07-ee2f-4e4b-8191-d1314ed1e545 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 34204 microversion: 2.20 time: 0.292695 May 25 15:42:13.745039 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 167/334] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:13 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 34204 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:14.168069 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-653bccec-efd0-4f5c-a7db-50b43aaac049 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:14.169111 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-653bccec-efd0-4f5c-a7db-50b43aaac049 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:14.182243 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-653bccec-efd0-4f5c-a7db-50b43aaac049 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:14.182697 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-653bccec-efd0-4f5c-a7db-50b43aaac049 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:14.183664 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-653bccec-efd0-4f5c-a7db-50b43aaac049 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:14.184128 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-653bccec-efd0-4f5c-a7db-50b43aaac049 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:14.348504 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-653bccec-efd0-4f5c-a7db-50b43aaac049 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 34349 microversion: 2.1 time: 0.184086 May 25 15:42:14.349202 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 168/335] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:14 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 34349 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:42:14.475544 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-be2202da-dbd9-4d35-8e3f-147d096eb91b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:14.477741 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-be2202da-dbd9-4d35-8e3f-147d096eb91b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:14.490307 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-be2202da-dbd9-4d35-8e3f-147d096eb91b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:14.490932 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-be2202da-dbd9-4d35-8e3f-147d096eb91b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:14.491823 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-be2202da-dbd9-4d35-8e3f-147d096eb91b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:14.492495 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-be2202da-dbd9-4d35-8e3f-147d096eb91b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:14.700917 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-be2202da-dbd9-4d35-8e3f-147d096eb91b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:14.703478 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1764641d-295e-4a6b-8afb-8c8d4ac0fd4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:14.704224 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1764641d-295e-4a6b-8afb-8c8d4ac0fd4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:14.710010 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-be2202da-dbd9-4d35-8e3f-147d096eb91b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1595 microversion: 2.1 time: 0.239349 May 25 15:42:14.710574 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 168/336] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:14 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1595 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:14.712423 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1764641d-295e-4a6b-8afb-8c8d4ac0fd4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:14.712887 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1764641d-295e-4a6b-8afb-8c8d4ac0fd4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:14.713682 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1764641d-295e-4a6b-8afb-8c8d4ac0fd4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:14.714420 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1764641d-295e-4a6b-8afb-8c8d4ac0fd4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:14.756301 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-53fa4a74-8ef7-4b9b-8f78-363574239b22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:14.757983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-53fa4a74-8ef7-4b9b-8f78-363574239b22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:14.766253 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-53fa4a74-8ef7-4b9b-8f78-363574239b22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:14.766670 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-53fa4a74-8ef7-4b9b-8f78-363574239b22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:14.767839 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-53fa4a74-8ef7-4b9b-8f78-363574239b22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:14.768457 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-53fa4a74-8ef7-4b9b-8f78-363574239b22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:14.907325 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-53fa4a74-8ef7-4b9b-8f78-363574239b22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 34712 microversion: 2.20 time: 0.156777 May 25 15:42:14.908230 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 169/337] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:14 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 34712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:42:15.002436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1764641d-295e-4a6b-8afb-8c8d4ac0fd4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:15.012250 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1764641d-295e-4a6b-8afb-8c8d4ac0fd4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.313087 May 25 15:42:15.013023 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 169/338] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:14 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:15.364030 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8a1d760b-229f-4f31-976c-34c378ba46e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:15.366066 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8a1d760b-229f-4f31-976c-34c378ba46e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:15.374578 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8a1d760b-229f-4f31-976c-34c378ba46e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:15.374996 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8a1d760b-229f-4f31-976c-34c378ba46e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:15.376138 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8a1d760b-229f-4f31-976c-34c378ba46e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:15.376750 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8a1d760b-229f-4f31-976c-34c378ba46e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:15.510771 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8a1d760b-229f-4f31-976c-34c378ba46e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 34881 microversion: 2.1 time: 0.152758 May 25 15:42:15.512899 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 170/339] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:15 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 34881 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:42:15.919322 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fdc546f2-54cf-4b35-a78b-23efc55b5312 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:15.920462 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fdc546f2-54cf-4b35-a78b-23efc55b5312 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:15.929492 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fdc546f2-54cf-4b35-a78b-23efc55b5312 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:15.930111 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fdc546f2-54cf-4b35-a78b-23efc55b5312 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:15.931016 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fdc546f2-54cf-4b35-a78b-23efc55b5312 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:15.931956 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fdc546f2-54cf-4b35-a78b-23efc55b5312 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:16.029547 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-092404bb-eb63-4226-bd0c-15a297d71b7a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:16.030347 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-092404bb-eb63-4226-bd0c-15a297d71b7a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:16.038659 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-092404bb-eb63-4226-bd0c-15a297d71b7a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:16.039193 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-092404bb-eb63-4226-bd0c-15a297d71b7a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:16.040095 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-092404bb-eb63-4226-bd0c-15a297d71b7a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:16.040674 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-092404bb-eb63-4226-bd0c-15a297d71b7a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:16.081915 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fdc546f2-54cf-4b35-a78b-23efc55b5312 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 35180 microversion: 2.20 time: 0.166436 May 25 15:42:16.083886 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 170/340] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:15 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 35180 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:16.291188 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-092404bb-eb63-4226-bd0c-15a297d71b7a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:16.310797 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-092404bb-eb63-4226-bd0c-15a297d71b7a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.285314 May 25 15:42:16.311545 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 171/341] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:16 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:16.525391 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-97b798bb-d87d-4b7a-a944-396009c07f3b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:16.526565 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-97b798bb-d87d-4b7a-a944-396009c07f3b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:16.534936 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97b798bb-d87d-4b7a-a944-396009c07f3b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:16.536311 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97b798bb-d87d-4b7a-a944-396009c07f3b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:16.537180 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97b798bb-d87d-4b7a-a944-396009c07f3b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:16.537681 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97b798bb-d87d-4b7a-a944-396009c07f3b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:16.713739 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-97b798bb-d87d-4b7a-a944-396009c07f3b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 35531 microversion: 2.1 time: 0.192178 May 25 15:42:16.715022 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 171/342] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:16 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 35531 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:42:17.094710 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ccc6e567-4c47-43bb-946a-c8c151b7760a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:17.095634 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ccc6e567-4c47-43bb-946a-c8c151b7760a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:17.104199 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ccc6e567-4c47-43bb-946a-c8c151b7760a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:17.104646 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ccc6e567-4c47-43bb-946a-c8c151b7760a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:17.105425 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ccc6e567-4c47-43bb-946a-c8c151b7760a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:17.105884 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ccc6e567-4c47-43bb-946a-c8c151b7760a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:17.240601 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ccc6e567-4c47-43bb-946a-c8c151b7760a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 35644 microversion: 2.20 time: 0.149368 May 25 15:42:17.241238 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 172/343] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:17 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 35644 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:42:17.328154 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-496a97be-d949-4e15-bbd3-54588340acd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:17.328881 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-496a97be-d949-4e15-bbd3-54588340acd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:17.337643 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-496a97be-d949-4e15-bbd3-54588340acd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:17.338097 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-496a97be-d949-4e15-bbd3-54588340acd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:17.338880 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-496a97be-d949-4e15-bbd3-54588340acd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:17.339416 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-496a97be-d949-4e15-bbd3-54588340acd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:17.683513 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-496a97be-d949-4e15-bbd3-54588340acd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:17.692659 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-496a97be-d949-4e15-bbd3-54588340acd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.368592 May 25 15:42:17.693262 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 172/344] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:17 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:17.710698 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-6855ebf8-d421-4fdb-97bc-f29c32bf0424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e39efa-e568-41dd-9368-376ead8b1020", "tag": "c536b9e5-ae17-4775-b209-71e6ec42122a"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:17.711275 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:42:17.711275 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:42:17.739340 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-30fe2b34-0dc0-49b8-b7ff-bacc873900fb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:17.744694 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-6855ebf8-d421-4fdb-97bc-f29c32bf0424 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:17.745710 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-30fe2b34-0dc0-49b8-b7ff-bacc873900fb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:17.748033 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-6855ebf8-d421-4fdb-97bc-f29c32bf0424 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:17.765927 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-30fe2b34-0dc0-49b8-b7ff-bacc873900fb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:17.769449 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-30fe2b34-0dc0-49b8-b7ff-bacc873900fb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:17.771947 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-30fe2b34-0dc0-49b8-b7ff-bacc873900fb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:17.773518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-30fe2b34-0dc0-49b8-b7ff-bacc873900fb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:17.804140 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-6855ebf8-d421-4fdb-97bc-f29c32bf0424 service nova] Creating event network-changed:c536b9e5-ae17-4775-b209-71e6ec42122a for instance 17e39efa-e568-41dd-9368-376ead8b1020 on hv-cinder-79123 May 25 15:42:17.820627 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-6855ebf8-d421-4fdb-97bc-f29c32bf0424 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126677 May 25 15:42:17.821491 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 173/345] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:42:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:42:18.012593 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-30fe2b34-0dc0-49b8-b7ff-bacc873900fb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 35989 microversion: 2.1 time: 0.282629 May 25 15:42:18.013846 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 173/346] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:17 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 35989 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:42:18.253441 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8b1d9501-5a77-4a98-b613-65a4c6fb0860 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:18.255113 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8b1d9501-5a77-4a98-b613-65a4c6fb0860 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:18.277858 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b1d9501-5a77-4a98-b613-65a4c6fb0860 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:18.278517 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b1d9501-5a77-4a98-b613-65a4c6fb0860 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:18.280098 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b1d9501-5a77-4a98-b613-65a4c6fb0860 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:18.282202 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b1d9501-5a77-4a98-b613-65a4c6fb0860 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:18.474666 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8b1d9501-5a77-4a98-b613-65a4c6fb0860 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 36268 microversion: 2.20 time: 0.225053 May 25 15:42:18.481412 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 174/347] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:18 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 36268 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:18.710763 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-488d19c0-c25a-480a-8373-81b760e906bd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:18.711972 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-488d19c0-c25a-480a-8373-81b760e906bd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:18.720440 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-488d19c0-c25a-480a-8373-81b760e906bd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:18.721030 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-488d19c0-c25a-480a-8373-81b760e906bd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:18.722075 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-488d19c0-c25a-480a-8373-81b760e906bd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:18.722815 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-488d19c0-c25a-480a-8373-81b760e906bd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.025467 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0cce1750-d983-485d-bbba-90a24967bc0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:19.027289 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0cce1750-d983-485d-bbba-90a24967bc0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:19.045900 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0cce1750-d983-485d-bbba-90a24967bc0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.046746 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0cce1750-d983-485d-bbba-90a24967bc0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.049367 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0cce1750-d983-485d-bbba-90a24967bc0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.050329 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0cce1750-d983-485d-bbba-90a24967bc0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.271247 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0cce1750-d983-485d-bbba-90a24967bc0c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 36728 microversion: 2.1 time: 0.249437 May 25 15:42:19.272626 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 175/348] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:19 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 36728 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:42:19.308712 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-322049059"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:19.309792 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:19.318710 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.319182 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.320257 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.320699 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.324530 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-488d19c0-c25a-480a-8373-81b760e906bd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:19.335706 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-488d19c0-c25a-480a-8373-81b760e906bd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1502 microversion: 2.1 time: 0.629359 May 25 15:42:19.336618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 174/349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:18 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1502 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:19.353794 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0bdecbf8-aee1-4545-a784-c02d03e9440c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "129c3e87-acea-436d-bd05-2522b9129393"}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:19.354855 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0bdecbf8-aee1-4545-a784-c02d03e9440c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:19.364776 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0bdecbf8-aee1-4545-a784-c02d03e9440c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.365467 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0bdecbf8-aee1-4545-a784-c02d03e9440c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.366667 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0bdecbf8-aee1-4545-a784-c02d03e9440c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.367338 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0bdecbf8-aee1-4545-a784-c02d03e9440c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.431076 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-0bdecbf8-aee1-4545-a784-c02d03e9440c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] HTTP exception thrown: Cannot 'attach_volume' instance 1b62e88c-87e4-4020-9fc4-9b2cffdc55de while it is in vm_state rescued May 25 15:42:19.431672 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0bdecbf8-aee1-4545-a784-c02d03e9440c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Returning 409 to user: Cannot 'attach_volume' instance 1b62e88c-87e4-4020-9fc4-9b2cffdc55de while it is in vm_state rescued {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:42:19.432717 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0bdecbf8-aee1-4545-a784-c02d03e9440c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "POST /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.082856 May 25 15:42:19.437159 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 175/350] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:42:19 2021] POST /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/os-volume_attachments => generated 152 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 15:42:19.443148 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f725b22a-abb5-493c-8a31-ff5a816dcc86 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:19.443805 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f725b22a-abb5-493c-8a31-ff5a816dcc86 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:19.452011 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f725b22a-abb5-493c-8a31-ff5a816dcc86 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.452785 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f725b22a-abb5-493c-8a31-ff5a816dcc86 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.453797 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f725b22a-abb5-493c-8a31-ff5a816dcc86 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.454388 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f725b22a-abb5-493c-8a31-ff5a816dcc86 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.582651 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.network.security_group_api [None req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Adding security group 17501c6a-8302-4871-b31d-a8c482336d39 to port c536b9e5-ae17-4775-b209-71e6ec42122a May 25 15:42:19.618608 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f725b22a-abb5-493c-8a31-ff5a816dcc86 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "POST /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/action" status: 202 len: 0 microversion: 2.1 time: 0.179880 May 25 15:42:19.619540 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 176/351] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:19 2021] POST /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:19.630259 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-97b518e0-b09f-45b0-a0a4-94e56778ea7e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:19.631415 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-97b518e0-b09f-45b0-a0a4-94e56778ea7e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:19.639722 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97b518e0-b09f-45b0-a0a4-94e56778ea7e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.640414 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97b518e0-b09f-45b0-a0a4-94e56778ea7e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.641294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97b518e0-b09f-45b0-a0a4-94e56778ea7e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.641966 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97b518e0-b09f-45b0-a0a4-94e56778ea7e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.803781 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-97b518e0-b09f-45b0-a0a4-94e56778ea7e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 37027 microversion: 2.20 time: 0.179495 May 25 15:42:19.804496 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 177/352] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:19 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 37027 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:19.815692 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2db0ce55-8a33-4569-b71e-12fe46034711 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:19.818002 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2db0ce55-8a33-4569-b71e-12fe46034711 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:19.826108 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2db0ce55-8a33-4569-b71e-12fe46034711 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.826916 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2db0ce55-8a33-4569-b71e-12fe46034711 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.828159 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2db0ce55-8a33-4569-b71e-12fe46034711 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.828818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2db0ce55-8a33-4569-b71e-12fe46034711 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:20.241953 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2db0ce55-8a33-4569-b71e-12fe46034711 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:20.257679 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2db0ce55-8a33-4569-b71e-12fe46034711 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1510 microversion: 2.1 time: 0.451162 May 25 15:42:20.258517 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 178/353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:19 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1510 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:20.274323 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/action" status: 202 len: 0 microversion: 2.1 time: 0.970212 May 25 15:42:20.276405 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 176/354] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:19 2021] POST /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/action => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:42:20.285368 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d6e6f0b3-765f-4662-ab28-e0f739287000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:20.287956 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d6e6f0b3-765f-4662-ab28-e0f739287000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:20.304252 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-37c9f5a6-74f4-497f-8cb1-7573222713d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e39efa-e568-41dd-9368-376ead8b1020", "tag": "c536b9e5-ae17-4775-b209-71e6ec42122a"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:20.313907 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:42:20.313907 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:42:20.327845 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d6e6f0b3-765f-4662-ab28-e0f739287000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:20.328688 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d6e6f0b3-765f-4662-ab28-e0f739287000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:20.329531 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d6e6f0b3-765f-4662-ab28-e0f739287000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:20.333639 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d6e6f0b3-765f-4662-ab28-e0f739287000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:20.347980 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-37c9f5a6-74f4-497f-8cb1-7573222713d7 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:20.348886 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-37c9f5a6-74f4-497f-8cb1-7573222713d7 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:20.387511 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-37c9f5a6-74f4-497f-8cb1-7573222713d7 service nova] Creating event network-changed:c536b9e5-ae17-4775-b209-71e6ec42122a for instance 17e39efa-e568-41dd-9368-376ead8b1020 on hv-cinder-79123 May 25 15:42:20.399313 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-37c9f5a6-74f4-497f-8cb1-7573222713d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121135 May 25 15:42:20.400759 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 179/355] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:42:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:42:20.411843 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-82e5aa41-4cf0-4bd3-ac18-82b7975f3424 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:20.418940 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-82e5aa41-4cf0-4bd3-ac18-82b7975f3424 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:20.435435 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-82e5aa41-4cf0-4bd3-ac18-82b7975f3424 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:20.436077 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-82e5aa41-4cf0-4bd3-ac18-82b7975f3424 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:20.436996 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-82e5aa41-4cf0-4bd3-ac18-82b7975f3424 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:20.437598 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-82e5aa41-4cf0-4bd3-ac18-82b7975f3424 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:20.574387 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d6e6f0b3-765f-4662-ab28-e0f739287000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 37362 microversion: 2.1 time: 0.294019 May 25 15:42:20.575549 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 177/356] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:20 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 37362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:42:20.820429 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-67bf65d3-6fc7-4803-9049-d71965f0fec0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:20.822207 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-67bf65d3-6fc7-4803-9049-d71965f0fec0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:20.840275 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-67bf65d3-6fc7-4803-9049-d71965f0fec0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:20.844185 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-67bf65d3-6fc7-4803-9049-d71965f0fec0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:20.845275 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-67bf65d3-6fc7-4803-9049-d71965f0fec0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:20.846030 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-67bf65d3-6fc7-4803-9049-d71965f0fec0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:20.998030 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-67bf65d3-6fc7-4803-9049-d71965f0fec0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 37676 microversion: 2.20 time: 0.185093 May 25 15:42:20.999520 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 178/357] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:20 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 37676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:42:21.043050 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-82e5aa41-4cf0-4bd3-ac18-82b7975f3424 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:21.060671 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-82e5aa41-4cf0-4bd3-ac18-82b7975f3424 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1759 microversion: 2.1 time: 0.658312 May 25 15:42:21.062366 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 180/358] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:20 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1759 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:21.275623 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f326ff07-3918-4588-baa1-c68beaee0df8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:21.276456 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f326ff07-3918-4588-baa1-c68beaee0df8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:21.288237 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f326ff07-3918-4588-baa1-c68beaee0df8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:21.289405 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f326ff07-3918-4588-baa1-c68beaee0df8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:21.290413 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f326ff07-3918-4588-baa1-c68beaee0df8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:21.291053 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f326ff07-3918-4588-baa1-c68beaee0df8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:21.586747 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5a0c3e01-35a7-479c-9e78-14672bf75afc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:21.588197 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5a0c3e01-35a7-479c-9e78-14672bf75afc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:21.602486 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a0c3e01-35a7-479c-9e78-14672bf75afc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:21.604726 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a0c3e01-35a7-479c-9e78-14672bf75afc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:21.611807 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a0c3e01-35a7-479c-9e78-14672bf75afc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:21.612376 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a0c3e01-35a7-479c-9e78-14672bf75afc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:21.617987 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f326ff07-3918-4588-baa1-c68beaee0df8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:21.630915 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f326ff07-3918-4588-baa1-c68beaee0df8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1510 microversion: 2.1 time: 0.359683 May 25 15:42:21.631500 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 179/359] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:21 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:21.806371 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5a0c3e01-35a7-479c-9e78-14672bf75afc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 37683 microversion: 2.1 time: 0.223573 May 25 15:42:21.816590 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 181/360] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:21 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 37683 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:42:22.010576 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4c603b95-22c6-452e-b375-884960b6b2ac tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:22.011534 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4c603b95-22c6-452e-b375-884960b6b2ac tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:22.018926 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4c603b95-22c6-452e-b375-884960b6b2ac tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:22.019388 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4c603b95-22c6-452e-b375-884960b6b2ac tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:22.020245 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4c603b95-22c6-452e-b375-884960b6b2ac tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:22.020689 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4c603b95-22c6-452e-b375-884960b6b2ac tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:22.154638 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4c603b95-22c6-452e-b375-884960b6b2ac tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 37997 microversion: 2.20 time: 0.147923 May 25 15:42:22.155281 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 180/361] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:22 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 37997 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:42:22.648861 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a52988a0-4840-41de-817b-7c1795a06111 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:22.649708 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a52988a0-4840-41de-817b-7c1795a06111 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:22.657775 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a52988a0-4840-41de-817b-7c1795a06111 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:22.658231 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a52988a0-4840-41de-817b-7c1795a06111 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:22.659007 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a52988a0-4840-41de-817b-7c1795a06111 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:22.659440 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a52988a0-4840-41de-817b-7c1795a06111 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:22.825367 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a24e6522-f4be-4d10-b086-dd0b632139c5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:22.827234 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a24e6522-f4be-4d10-b086-dd0b632139c5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:22.840948 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a24e6522-f4be-4d10-b086-dd0b632139c5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:22.841742 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a24e6522-f4be-4d10-b086-dd0b632139c5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:22.843006 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a24e6522-f4be-4d10-b086-dd0b632139c5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:22.843643 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a24e6522-f4be-4d10-b086-dd0b632139c5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:22.906721 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a52988a0-4840-41de-817b-7c1795a06111 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:22.919301 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a52988a0-4840-41de-817b-7c1795a06111 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1510 microversion: 2.1 time: 0.274721 May 25 15:42:22.925058 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 182/362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:22 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1510 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:23.091392 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a24e6522-f4be-4d10-b086-dd0b632139c5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 200 len: 38211 microversion: 2.1 time: 0.273875 May 25 15:42:23.092245 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 181/363] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:22 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 38211 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:42:23.102860 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ce60e88c-8c0c-45ee-9db6-7e27abde8219 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:23.103359 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ce60e88c-8c0c-45ee-9db6-7e27abde8219 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:23.110602 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce60e88c-8c0c-45ee-9db6-7e27abde8219 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:23.111060 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce60e88c-8c0c-45ee-9db6-7e27abde8219 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:23.111822 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce60e88c-8c0c-45ee-9db6-7e27abde8219 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:23.112301 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce60e88c-8c0c-45ee-9db6-7e27abde8219 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:23.171344 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-dbb63d0a-68d3-4c76-8cb4-a1d1ec017ff8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:23.172590 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-dbb63d0a-68d3-4c76-8cb4-a1d1ec017ff8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:23.174054 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ce60e88c-8c0c-45ee-9db6-7e27abde8219 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/ips" status: 200 len: 146 microversion: 2.1 time: 0.074954 May 25 15:42:23.174626 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 183/364] 10.222.0.36 () {58 vars in 1248 bytes} [Tue May 25 15:42:23 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/ips => generated 146 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:42:23.183426 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dbb63d0a-68d3-4c76-8cb4-a1d1ec017ff8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:23.184033 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dbb63d0a-68d3-4c76-8cb4-a1d1ec017ff8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:23.185022 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dbb63d0a-68d3-4c76-8cb4-a1d1ec017ff8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:23.186034 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dbb63d0a-68d3-4c76-8cb4-a1d1ec017ff8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:23.338531 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-dbb63d0a-68d3-4c76-8cb4-a1d1ec017ff8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 38263 microversion: 2.20 time: 0.174158 May 25 15:42:23.339435 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 182/365] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:23 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 38263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:23.938834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-911bfde9-5c99-4c16-b12f-a2cd07ff09d7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:23.939627 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-911bfde9-5c99-4c16-b12f-a2cd07ff09d7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:23.948321 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-911bfde9-5c99-4c16-b12f-a2cd07ff09d7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:23.948792 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-911bfde9-5c99-4c16-b12f-a2cd07ff09d7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:23.949577 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-911bfde9-5c99-4c16-b12f-a2cd07ff09d7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:23.950013 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-911bfde9-5c99-4c16-b12f-a2cd07ff09d7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:24.180496 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-911bfde9-5c99-4c16-b12f-a2cd07ff09d7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:24.190017 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-911bfde9-5c99-4c16-b12f-a2cd07ff09d7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1510 microversion: 2.1 time: 0.255548 May 25 15:42:24.191243 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 184/366] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:23 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:24.351454 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c5e0bf09-6993-4cee-9819-550674632bbe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:24.352512 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c5e0bf09-6993-4cee-9819-550674632bbe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:24.360547 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c5e0bf09-6993-4cee-9819-550674632bbe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:24.361007 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c5e0bf09-6993-4cee-9819-550674632bbe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:24.361845 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c5e0bf09-6993-4cee-9819-550674632bbe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:24.362291 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c5e0bf09-6993-4cee-9819-550674632bbe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:24.497547 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c5e0bf09-6993-4cee-9819-550674632bbe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 200 len: 38404 microversion: 2.20 time: 0.150048 May 25 15:42:24.498932 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 183/367] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:24 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 38404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:42:24.509108 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3b924083-6edf-4881-8679-f75240c1803e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:24.509865 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3b924083-6edf-4881-8679-f75240c1803e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:24.518793 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b924083-6edf-4881-8679-f75240c1803e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:24.519407 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b924083-6edf-4881-8679-f75240c1803e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:24.520955 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b924083-6edf-4881-8679-f75240c1803e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:24.521544 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b924083-6edf-4881-8679-f75240c1803e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:24.581351 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3b924083-6edf-4881-8679-f75240c1803e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/ips" status: 200 len: 152 microversion: 2.20 time: 0.075658 May 25 15:42:24.582809 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 185/368] 10.222.0.36 () {60 vars in 1289 bytes} [Tue May 25 15:42:24 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/ips => generated 152 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:42:25.209045 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-adc9f113-ef34-4102-9217-ae89b965443a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:25.209761 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-adc9f113-ef34-4102-9217-ae89b965443a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:25.230543 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-adc9f113-ef34-4102-9217-ae89b965443a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:25.230992 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-adc9f113-ef34-4102-9217-ae89b965443a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:25.240975 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-adc9f113-ef34-4102-9217-ae89b965443a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:25.241529 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-adc9f113-ef34-4102-9217-ae89b965443a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:25.689544 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-adc9f113-ef34-4102-9217-ae89b965443a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:25.708883 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-adc9f113-ef34-4102-9217-ae89b965443a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1516 microversion: 2.1 time: 0.504683 May 25 15:42:25.724402 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 184/369] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:25 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1516 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:27.070037 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f936a61c-cd4a-4961-90ce-8d61781836d4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd0edb17-77cc-4d9f-b4d9-a0be55921a91"}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:27.072317 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f936a61c-cd4a-4961-90ce-8d61781836d4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:27.083987 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f936a61c-cd4a-4961-90ce-8d61781836d4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:27.084628 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f936a61c-cd4a-4961-90ce-8d61781836d4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:27.085586 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f936a61c-cd4a-4961-90ce-8d61781836d4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:27.086875 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f936a61c-cd4a-4961-90ce-8d61781836d4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:27.479185 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b9959fe6-aa27-4e46-aabe-ec967aa4b896 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:27.480509 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b9959fe6-aa27-4e46-aabe-ec967aa4b896 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:27.490732 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b9959fe6-aa27-4e46-aabe-ec967aa4b896 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:27.493245 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b9959fe6-aa27-4e46-aabe-ec967aa4b896 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:27.494554 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b9959fe6-aa27-4e46-aabe-ec967aa4b896 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:27.495283 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b9959fe6-aa27-4e46-aabe-ec967aa4b896 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:27.663834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f936a61c-cd4a-4961-90ce-8d61781836d4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.600081 May 25 15:42:27.666969 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 186/370] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:42:27 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/os-volume_attachments => generated 194 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:42:27.689701 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-783f9242-872f-4bff-ab9d-9f140cf619e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:27.690675 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-783f9242-872f-4bff-ab9d-9f140cf619e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:27.702826 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-783f9242-872f-4bff-ab9d-9f140cf619e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:27.703597 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-783f9242-872f-4bff-ab9d-9f140cf619e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:27.704902 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-783f9242-872f-4bff-ab9d-9f140cf619e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:27.706029 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-783f9242-872f-4bff-ab9d-9f140cf619e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:27.788495 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.objects.instance [None req-783f9242-872f-4bff-ab9d-9f140cf619e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lazy-loading 'flavor' on Instance uuid 9301f1db-ecb0-465b-858c-64a2bfd4d5cb {{(pid=112577) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:42:27.965877 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b9959fe6-aa27-4e46-aabe-ec967aa4b896 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:27.980596 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b9959fe6-aa27-4e46-aabe-ec967aa4b896 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1516 microversion: 2.1 time: 0.505328 May 25 15:42:27.981254 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 185/371] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:27 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1516 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:28.001222 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3099cdf4-e0bc-460f-8697-d04e05774b0d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b806c39-6512-4e14-aea2-284e47265542"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:28.008259 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-3099cdf4-e0bc-460f-8697-d04e05774b0d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:28.024816 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3099cdf4-e0bc-460f-8697-d04e05774b0d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:28.025472 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3099cdf4-e0bc-460f-8697-d04e05774b0d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:28.026843 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3099cdf4-e0bc-460f-8697-d04e05774b0d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:28.027439 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3099cdf4-e0bc-460f-8697-d04e05774b0d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:28.296134 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-783f9242-872f-4bff-ab9d-9f140cf619e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 202 len: 0 microversion: 2.20 time: 0.627389 May 25 15:42:28.296818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 187/372] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:42:27 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:42:28.307317 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:28.308066 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:28.317900 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:28.318364 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:28.319164 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:28.319616 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:28.607298 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3099cdf4-e0bc-460f-8697-d04e05774b0d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "POST /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.613567 May 25 15:42:28.608312 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 186/373] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:42:27 2021] POST /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/os-volume_attachments => generated 194 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:42:28.699238 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:28.710604 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:28.718831 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:28.718831 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.416105 May 25 15:42:28.724693 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 188/374] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:28 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:42:29.745019 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7a52b5ca-6555-4c32-987a-588fab2a2862 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:29.746314 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7a52b5ca-6555-4c32-987a-588fab2a2862 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:29.756709 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7a52b5ca-6555-4c32-987a-588fab2a2862 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:29.757481 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7a52b5ca-6555-4c32-987a-588fab2a2862 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:29.758534 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7a52b5ca-6555-4c32-987a-588fab2a2862 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:29.759069 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7a52b5ca-6555-4c32-987a-588fab2a2862 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:30.153470 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7a52b5ca-6555-4c32-987a-588fab2a2862 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:30.170358 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7a52b5ca-6555-4c32-987a-588fab2a2862 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:30.172242 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7a52b5ca-6555-4c32-987a-588fab2a2862 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:30.173681 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7a52b5ca-6555-4c32-987a-588fab2a2862 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.433921 May 25 15:42:30.186010 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 187/375] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:29 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:31.193624 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-57456f67-1119-4808-b644-ef0e15797427 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:31.194253 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-57456f67-1119-4808-b644-ef0e15797427 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:31.215517 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-57456f67-1119-4808-b644-ef0e15797427 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:31.218885 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-57456f67-1119-4808-b644-ef0e15797427 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:31.220594 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-57456f67-1119-4808-b644-ef0e15797427 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:31.223344 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-57456f67-1119-4808-b644-ef0e15797427 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:31.508146 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-57456f67-1119-4808-b644-ef0e15797427 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:31.522180 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-57456f67-1119-4808-b644-ef0e15797427 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:31.523761 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-57456f67-1119-4808-b644-ef0e15797427 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:31.525148 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-57456f67-1119-4808-b644-ef0e15797427 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.335943 May 25 15:42:31.525877 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 189/376] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:31 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:32.544216 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:32.545419 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:32.574137 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:32.585054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:32.586308 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:32.586969 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:32.736673 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-469063748", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "networks": [{"uuid": "71fe9388-47c1-4797-9687-8ab41ffa2ce9"}]}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:32.830311 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] validate_networks() for [('71fe9388-47c1-4797-9687-8ab41ffa2ce9', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:42:33.127781 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:33.150194 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:33.151988 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:33.153363 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.613112 May 25 15:42:33.154095 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 188/377] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:32 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:42:33.782386 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:42:33.783212 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:42:33.783711 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:42:33.784164 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:42:33.784595 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:42:33.803439 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:33.803933 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:33.804976 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:33.805858 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:33.835603 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Getting quotas for project b4d6b8a11a0d4e2c97f55bde6cd2c234. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:42:33.840561 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Getting quotas for user 23958e7697bd4a84b8ec0a7992437036 and project b4d6b8a11a0d4e2c97f55bde6cd2c234. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:42:33.853656 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:42:33.856968 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:42:33.920872 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187967 May 25 15:42:33.921604 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 190/378] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:42:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 15:42:33.932071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d7d3c0b5-f760-426d-8209-f4797a56e878 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:33.932777 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d7d3c0b5-f760-426d-8209-f4797a56e878 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:34.107721 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d7d3c0b5-f760-426d-8209-f4797a56e878 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:34.116357 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d7d3c0b5-f760-426d-8209-f4797a56e878 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1213 microversion: 2.1 time: 0.187898 May 25 15:42:34.117694 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 189/379] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:33 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1213 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:34.177629 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a91b434c-22a1-4a33-a8a9-e34624ca396e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:34.178258 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a91b434c-22a1-4a33-a8a9-e34624ca396e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:34.195213 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a91b434c-22a1-4a33-a8a9-e34624ca396e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:34.196906 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a91b434c-22a1-4a33-a8a9-e34624ca396e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:34.200370 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a91b434c-22a1-4a33-a8a9-e34624ca396e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:34.203024 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a91b434c-22a1-4a33-a8a9-e34624ca396e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:34.562997 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a91b434c-22a1-4a33-a8a9-e34624ca396e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:34.585734 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a91b434c-22a1-4a33-a8a9-e34624ca396e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:34.587517 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a91b434c-22a1-4a33-a8a9-e34624ca396e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:34.600837 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a91b434c-22a1-4a33-a8a9-e34624ca396e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.428957 May 25 15:42:34.601811 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 191/380] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:34 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:35.132647 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1fe55d70-2af5-4e32-a2d8-a31ef7f4b1d6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:35.133916 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1fe55d70-2af5-4e32-a2d8-a31ef7f4b1d6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:35.151848 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1fe55d70-2af5-4e32-a2d8-a31ef7f4b1d6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:35.152334 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1fe55d70-2af5-4e32-a2d8-a31ef7f4b1d6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:35.153131 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1fe55d70-2af5-4e32-a2d8-a31ef7f4b1d6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:35.153682 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1fe55d70-2af5-4e32-a2d8-a31ef7f4b1d6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:35.370718 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1fe55d70-2af5-4e32-a2d8-a31ef7f4b1d6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:35.386746 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1fe55d70-2af5-4e32-a2d8-a31ef7f4b1d6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1265 microversion: 2.1 time: 0.257684 May 25 15:42:35.387338 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 190/381] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:35 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:35.618711 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:35.619910 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:35.630316 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:35.633508 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:35.637048 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:35.640440 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:35.981490 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-869caa0d-1d1e-491d-9984-1569a7ed59f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:35.996115 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-869caa0d-1d1e-491d-9984-1569a7ed59f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:35.996828 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-869caa0d-1d1e-491d-9984-1569a7ed59f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:36.126229 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:36.130754 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-869caa0d-1d1e-491d-9984-1569a7ed59f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Going to try to stop instance {{(pid=112576) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 25 15:42:36.150581 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:36.153144 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:36.154355 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.539695 May 25 15:42:36.169032 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 192/382] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:35 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:36.236534 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-869caa0d-1d1e-491d-9984-1569a7ed59f5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 202 len: 0 microversion: 2.1 time: 0.259722 May 25 15:42:36.237046 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 191/383] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:35 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:42:36.245790 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-15eb9155-1ca1-4465-85dd-c70806371816 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:36.246380 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-15eb9155-1ca1-4465-85dd-c70806371816 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:36.260086 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-15eb9155-1ca1-4465-85dd-c70806371816 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:36.262294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-15eb9155-1ca1-4465-85dd-c70806371816 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:36.263800 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-15eb9155-1ca1-4465-85dd-c70806371816 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:36.264977 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-15eb9155-1ca1-4465-85dd-c70806371816 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:36.403715 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4609961a-ebed-4de9-a7b8-e9d58c559851 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:36.404471 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4609961a-ebed-4de9-a7b8-e9d58c559851 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:36.420805 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4609961a-ebed-4de9-a7b8-e9d58c559851 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:36.421602 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4609961a-ebed-4de9-a7b8-e9d58c559851 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:36.422635 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4609961a-ebed-4de9-a7b8-e9d58c559851 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:36.423277 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4609961a-ebed-4de9-a7b8-e9d58c559851 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:36.596823 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4609961a-ebed-4de9-a7b8-e9d58c559851 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:36.608067 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4609961a-ebed-4de9-a7b8-e9d58c559851 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1271 microversion: 2.1 time: 0.208236 May 25 15:42:36.608936 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 192/384] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:36 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:36.686951 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-15eb9155-1ca1-4465-85dd-c70806371816 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:36.709394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-15eb9155-1ca1-4465-85dd-c70806371816 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.467231 May 25 15:42:36.720174 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 193/385] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:36 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:37.173497 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-102c1fc9-148d-462f-9156-ac4c9b42f76a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:37.174195 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-102c1fc9-148d-462f-9156-ac4c9b42f76a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:37.186171 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-102c1fc9-148d-462f-9156-ac4c9b42f76a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:37.186641 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-102c1fc9-148d-462f-9156-ac4c9b42f76a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:37.187443 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-102c1fc9-148d-462f-9156-ac4c9b42f76a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:37.187912 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-102c1fc9-148d-462f-9156-ac4c9b42f76a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:37.429674 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-beee2748-4814-4a34-b17c-6d37551f0779 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Action: 'create', calling method: .version_select at 0x7f0885984af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-980388926"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:37.452691 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-beee2748-4814-4a34-b17c-6d37551f0779 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Getting quotas for project 8dff1003ceba47f6a75b4c3901343b7b. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:42:37.458363 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-beee2748-4814-4a34-b17c-6d37551f0779 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Getting quotas for user 082a0ad3211940cda30d219bb251e2fe and project 8dff1003ceba47f6a75b4c3901343b7b. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:42:37.603586 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-102c1fc9-148d-462f-9156-ac4c9b42f76a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:37.619595 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-102c1fc9-148d-462f-9156-ac4c9b42f76a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:37.621585 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-102c1fc9-148d-462f-9156-ac4c9b42f76a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:37.623699 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-102c1fc9-148d-462f-9156-ac4c9b42f76a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.453974 May 25 15:42:37.626052 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 194/386] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:37 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:42:37.632273 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:37.633305 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:37.643347 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:37.644145 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:37.646011 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:37.646674 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:37.925723 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-beee2748-4814-4a34-b17c-6d37551f0779 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Getting quotas for project 8dff1003ceba47f6a75b4c3901343b7b. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:42:37.929842 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-beee2748-4814-4a34-b17c-6d37551f0779 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Getting quotas for user 082a0ad3211940cda30d219bb251e2fe and project 8dff1003ceba47f6a75b4c3901343b7b. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:42:37.943162 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-beee2748-4814-4a34-b17c-6d37551f0779 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.822011 May 25 15:42:37.943883 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 193/387] 10.222.0.36 () {60 vars in 1158 bytes} [Tue May 25 15:42:37 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:37.952746 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d1ff0279-c52d-4221-a8c3-2152dbecd862 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:37.954716 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d1ff0279-c52d-4221-a8c3-2152dbecd862 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:37.967782 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d1ff0279-c52d-4221-a8c3-2152dbecd862 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:37.968615 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d1ff0279-c52d-4221-a8c3-2152dbecd862 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:37.970411 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d1ff0279-c52d-4221-a8c3-2152dbecd862 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:37.971249 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d1ff0279-c52d-4221-a8c3-2152dbecd862 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:38.239071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d1ff0279-c52d-4221-a8c3-2152dbecd862 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:38.268475 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d1ff0279-c52d-4221-a8c3-2152dbecd862 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.323033 May 25 15:42:38.269450 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 194/388] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:37 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:38.397812 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:38.411691 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1313 microversion: 2.1 time: 0.784205 May 25 15:42:38.412802 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 195/389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:37 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:38.629395 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-4fcceb1f-83f0-4e2a-bc72-6650ef3b1800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f388fe6-4e89-48f0-bf54-e1ff840faed9", "tag": "36833437-89ff-4bb3-978e-a332e89af2e5"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:38.632077 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:42:38.632077 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:42:38.645936 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c920619c-2b20-4e7a-b215-be04f159866e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:38.647171 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c920619c-2b20-4e7a-b215-be04f159866e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:38.663898 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c920619c-2b20-4e7a-b215-be04f159866e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:38.665489 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-4fcceb1f-83f0-4e2a-bc72-6650ef3b1800 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:38.665967 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c920619c-2b20-4e7a-b215-be04f159866e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:38.667091 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-4fcceb1f-83f0-4e2a-bc72-6650ef3b1800 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:38.670974 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c920619c-2b20-4e7a-b215-be04f159866e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:38.671683 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c920619c-2b20-4e7a-b215-be04f159866e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:38.708260 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-4fcceb1f-83f0-4e2a-bc72-6650ef3b1800 service nova] Creating event network-changed:36833437-89ff-4bb3-978e-a332e89af2e5 for instance 3f388fe6-4e89-48f0-bf54-e1ff840faed9 on hv-cinder-79123 May 25 15:42:38.718747 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-4fcceb1f-83f0-4e2a-bc72-6650ef3b1800 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096547 May 25 15:42:38.724905 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 195/390] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:42:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:42:39.093031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c920619c-2b20-4e7a-b215-be04f159866e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:39.109987 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c920619c-2b20-4e7a-b215-be04f159866e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:39.112143 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c920619c-2b20-4e7a-b215-be04f159866e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:39.115481 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c920619c-2b20-4e7a-b215-be04f159866e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.474869 May 25 15:42:39.116434 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 196/391] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:38 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:39.287825 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-187b3533-e6cd-42b1-8224-42b5aa4366cf tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:39.288868 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-187b3533-e6cd-42b1-8224-42b5aa4366cf tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:39.305595 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-187b3533-e6cd-42b1-8224-42b5aa4366cf tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:39.306172 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-187b3533-e6cd-42b1-8224-42b5aa4366cf tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:39.307088 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-187b3533-e6cd-42b1-8224-42b5aa4366cf tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:39.308632 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-187b3533-e6cd-42b1-8224-42b5aa4366cf tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:39.441991 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4ae36b9e-24db-4d45-be52-9829972010ab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:39.444107 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4ae36b9e-24db-4d45-be52-9829972010ab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:39.456920 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4ae36b9e-24db-4d45-be52-9829972010ab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:39.459198 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4ae36b9e-24db-4d45-be52-9829972010ab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:39.461385 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4ae36b9e-24db-4d45-be52-9829972010ab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:39.462758 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4ae36b9e-24db-4d45-be52-9829972010ab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:39.600796 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-187b3533-e6cd-42b1-8224-42b5aa4366cf tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:39.614017 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-187b3533-e6cd-42b1-8224-42b5aa4366cf tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.330819 May 25 15:42:39.617032 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 196/392] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:39 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:39.896350 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4ae36b9e-24db-4d45-be52-9829972010ab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:39.904680 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4ae36b9e-24db-4d45-be52-9829972010ab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1313 microversion: 2.1 time: 0.477112 May 25 15:42:39.914829 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 197/393] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:39 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:40.134477 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:40.135803 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:40.151322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:40.154229 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:40.156036 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:40.156485 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:40.535879 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:40.546234 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:40.547739 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:40.548923 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.418712 May 25 15:42:40.549479 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 197/394] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:40 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:40.633232 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-332a7149-098e-4d9e-bc72-268c8ffdadcc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:40.633853 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-332a7149-098e-4d9e-bc72-268c8ffdadcc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:40.644081 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-332a7149-098e-4d9e-bc72-268c8ffdadcc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:40.644569 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-332a7149-098e-4d9e-bc72-268c8ffdadcc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:40.645351 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-332a7149-098e-4d9e-bc72-268c8ffdadcc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:40.645788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-332a7149-098e-4d9e-bc72-268c8ffdadcc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:40.864112 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-332a7149-098e-4d9e-bc72-268c8ffdadcc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:40.873417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-332a7149-098e-4d9e-bc72-268c8ffdadcc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.244482 May 25 15:42:40.874201 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 198/395] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:40 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:40.921514 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:40.922157 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:40.930495 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:40.931232 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:40.932068 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:40.932523 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:41.161775 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:41.170989 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1313 microversion: 2.1 time: 0.253229 May 25 15:42:41.171563 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 198/396] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:40 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:41.566980 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:41.567704 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:41.575614 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:41.576120 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:41.576909 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:41.577354 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:41.772676 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:41.781392 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:41.782954 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:41.784180 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.221000 May 25 15:42:41.784749 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 199/397] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:41 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:41.890764 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9fa16ce8-361c-4dee-baa9-d829bdb25b91 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:41.891381 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9fa16ce8-361c-4dee-baa9-d829bdb25b91 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:41.899432 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9fa16ce8-361c-4dee-baa9-d829bdb25b91 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:41.899995 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9fa16ce8-361c-4dee-baa9-d829bdb25b91 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:41.900878 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9fa16ce8-361c-4dee-baa9-d829bdb25b91 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:41.901323 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9fa16ce8-361c-4dee-baa9-d829bdb25b91 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:42.097492 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9fa16ce8-361c-4dee-baa9-d829bdb25b91 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:42.106230 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9fa16ce8-361c-4dee-baa9-d829bdb25b91 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.219275 May 25 15:42:42.106793 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 199/398] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:41 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:42.188088 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-01b0a1a9-6e8a-4c30-b7e1-5219e33b266d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:42.188716 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-01b0a1a9-6e8a-4c30-b7e1-5219e33b266d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:42.196672 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-01b0a1a9-6e8a-4c30-b7e1-5219e33b266d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:42.197236 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-01b0a1a9-6e8a-4c30-b7e1-5219e33b266d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:42.198126 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-01b0a1a9-6e8a-4c30-b7e1-5219e33b266d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:42.198575 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-01b0a1a9-6e8a-4c30-b7e1-5219e33b266d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:42.416591 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-01b0a1a9-6e8a-4c30-b7e1-5219e33b266d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:42.427210 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-01b0a1a9-6e8a-4c30-b7e1-5219e33b266d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1313 microversion: 2.1 time: 0.242612 May 25 15:42:42.428050 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 200/399] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:42 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:42.802776 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:42.803393 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:42.811152 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:42.811687 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:42.812513 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:42.812963 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:43.022060 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:43.031891 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:43.034085 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:43.035369 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.236928 May 25 15:42:43.036327 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 200/400] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:42 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:43.124234 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a9119e99-4598-4d8e-bf9a-66a0abae0b64 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:43.124904 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a9119e99-4598-4d8e-bf9a-66a0abae0b64 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:43.133191 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a9119e99-4598-4d8e-bf9a-66a0abae0b64 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:43.133672 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a9119e99-4598-4d8e-bf9a-66a0abae0b64 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:43.134447 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a9119e99-4598-4d8e-bf9a-66a0abae0b64 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:43.134892 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a9119e99-4598-4d8e-bf9a-66a0abae0b64 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:43.339766 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a9119e99-4598-4d8e-bf9a-66a0abae0b64 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:43.349080 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a9119e99-4598-4d8e-bf9a-66a0abae0b64 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.228805 May 25 15:42:43.349797 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 201/401] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:43 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:43.445954 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6c6d7b3f-6f0e-4d1b-b30a-0db548bd0e6a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:43.446699 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6c6d7b3f-6f0e-4d1b-b30a-0db548bd0e6a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:43.454002 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6c6d7b3f-6f0e-4d1b-b30a-0db548bd0e6a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:43.454769 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6c6d7b3f-6f0e-4d1b-b30a-0db548bd0e6a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:43.455684 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6c6d7b3f-6f0e-4d1b-b30a-0db548bd0e6a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:43.456233 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6c6d7b3f-6f0e-4d1b-b30a-0db548bd0e6a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:43.551527 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-082def58-ca7e-4882-b3dd-eb903773f270 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:43.552936 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-082def58-ca7e-4882-b3dd-eb903773f270 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:43.560758 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-082def58-ca7e-4882-b3dd-eb903773f270 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:43.561562 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-082def58-ca7e-4882-b3dd-eb903773f270 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:43.563024 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-082def58-ca7e-4882-b3dd-eb903773f270 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:43.563735 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-082def58-ca7e-4882-b3dd-eb903773f270 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:43.634114 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.objects.instance [None req-082def58-ca7e-4882-b3dd-eb903773f270 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lazy-loading 'flavor' on Instance uuid 1b62e88c-87e4-4020-9fc4-9b2cffdc55de {{(pid=112577) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:42:43.669268 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6c6d7b3f-6f0e-4d1b-b30a-0db548bd0e6a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:43.678794 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6c6d7b3f-6f0e-4d1b-b30a-0db548bd0e6a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1313 microversion: 2.1 time: 0.237646 May 25 15:42:43.679572 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 201/402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:43 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:43.875269 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-082def58-ca7e-4882-b3dd-eb903773f270 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "POST /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/action" status: 200 len: 32 microversion: 2.1 time: 0.327373 May 25 15:42:43.879513 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 202/403] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:42:43 2021] POST /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/action => generated 32 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:42:43.886654 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-eb9fb575-e82d-422e-96ea-8ce9c6236c47 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:43.887287 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-eb9fb575-e82d-422e-96ea-8ce9c6236c47 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:43.895031 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb9fb575-e82d-422e-96ea-8ce9c6236c47 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:43.895625 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb9fb575-e82d-422e-96ea-8ce9c6236c47 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:43.896681 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb9fb575-e82d-422e-96ea-8ce9c6236c47 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:43.897134 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb9fb575-e82d-422e-96ea-8ce9c6236c47 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:44.054378 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-97c77325-d813-4d87-a228-20f52b93d5b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:44.055284 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-97c77325-d813-4d87-a228-20f52b93d5b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:44.062907 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97c77325-d813-4d87-a228-20f52b93d5b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:44.063372 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97c77325-d813-4d87-a228-20f52b93d5b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:44.064186 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97c77325-d813-4d87-a228-20f52b93d5b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:44.064631 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97c77325-d813-4d87-a228-20f52b93d5b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:44.112873 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-eb9fb575-e82d-422e-96ea-8ce9c6236c47 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:44.123178 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-eb9fb575-e82d-422e-96ea-8ce9c6236c47 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.241372 May 25 15:42:44.123884 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 202/404] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:43 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:44.369935 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-25f19be1-90e9-481c-820c-ffcd44592724 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:44.370724 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-25f19be1-90e9-481c-820c-ffcd44592724 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:44.378361 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-25f19be1-90e9-481c-820c-ffcd44592724 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:44.378829 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-25f19be1-90e9-481c-820c-ffcd44592724 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:44.379740 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-25f19be1-90e9-481c-820c-ffcd44592724 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:44.380214 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-25f19be1-90e9-481c-820c-ffcd44592724 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:44.402408 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-97c77325-d813-4d87-a228-20f52b93d5b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:44.412064 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-97c77325-d813-4d87-a228-20f52b93d5b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:44.413687 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-97c77325-d813-4d87-a228-20f52b93d5b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:44.414915 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-97c77325-d813-4d87-a228-20f52b93d5b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.365197 May 25 15:42:44.415613 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 203/405] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:44 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:42:44.580499 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-25f19be1-90e9-481c-820c-ffcd44592724 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:44.590266 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-25f19be1-90e9-481c-820c-ffcd44592724 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.224406 May 25 15:42:44.590846 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 203/406] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:44 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:44.695780 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-072422d2-56e9-4cf7-9518-d7c5f34324a5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:44.696528 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-072422d2-56e9-4cf7-9518-d7c5f34324a5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:44.709418 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-072422d2-56e9-4cf7-9518-d7c5f34324a5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:44.710273 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-072422d2-56e9-4cf7-9518-d7c5f34324a5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:44.711161 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-072422d2-56e9-4cf7-9518-d7c5f34324a5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:44.711711 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-072422d2-56e9-4cf7-9518-d7c5f34324a5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:44.956565 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-072422d2-56e9-4cf7-9518-d7c5f34324a5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:44.965571 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-072422d2-56e9-4cf7-9518-d7c5f34324a5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1313 microversion: 2.1 time: 0.273466 May 25 15:42:44.966162 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 204/407] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:44 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:45.140066 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-edfa5ab3-d89a-474e-b157-361d1c0cacc0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:45.140602 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-edfa5ab3-d89a-474e-b157-361d1c0cacc0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:45.148452 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-edfa5ab3-d89a-474e-b157-361d1c0cacc0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:45.148913 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-edfa5ab3-d89a-474e-b157-361d1c0cacc0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:45.149692 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-edfa5ab3-d89a-474e-b157-361d1c0cacc0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:45.150137 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-edfa5ab3-d89a-474e-b157-361d1c0cacc0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:45.344186 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-edfa5ab3-d89a-474e-b157-361d1c0cacc0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:45.353675 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-edfa5ab3-d89a-474e-b157-361d1c0cacc0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.217438 May 25 15:42:45.354239 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 204/408] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:45 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:45.435250 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1c0b2e42-1721-47d3-91a3-b33919da5912 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:45.435789 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1c0b2e42-1721-47d3-91a3-b33919da5912 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:45.443282 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1c0b2e42-1721-47d3-91a3-b33919da5912 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:45.443737 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1c0b2e42-1721-47d3-91a3-b33919da5912 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:45.444557 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1c0b2e42-1721-47d3-91a3-b33919da5912 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:45.445000 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1c0b2e42-1721-47d3-91a3-b33919da5912 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:45.607394 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4dd161ad-98fb-48d1-9b2b-395593db031a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:45.608063 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4dd161ad-98fb-48d1-9b2b-395593db031a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:45.615587 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4dd161ad-98fb-48d1-9b2b-395593db031a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:45.616099 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4dd161ad-98fb-48d1-9b2b-395593db031a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:45.616890 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4dd161ad-98fb-48d1-9b2b-395593db031a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:45.617340 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4dd161ad-98fb-48d1-9b2b-395593db031a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:45.642741 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1c0b2e42-1721-47d3-91a3-b33919da5912 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:45.652060 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1c0b2e42-1721-47d3-91a3-b33919da5912 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:45.653635 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1c0b2e42-1721-47d3-91a3-b33919da5912 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:45.654785 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1c0b2e42-1721-47d3-91a3-b33919da5912 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.224030 May 25 15:42:45.655354 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 205/409] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:45 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:42:45.818970 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4dd161ad-98fb-48d1-9b2b-395593db031a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:45.827911 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4dd161ad-98fb-48d1-9b2b-395593db031a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.224120 May 25 15:42:45.828482 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 205/410] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:45 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:45.982559 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3b6e003f-3ccc-4341-a94b-e367588c635c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:45.983104 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3b6e003f-3ccc-4341-a94b-e367588c635c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:45.990782 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b6e003f-3ccc-4341-a94b-e367588c635c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:45.991239 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b6e003f-3ccc-4341-a94b-e367588c635c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:45.992059 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b6e003f-3ccc-4341-a94b-e367588c635c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:45.992505 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b6e003f-3ccc-4341-a94b-e367588c635c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:46.194031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3b6e003f-3ccc-4341-a94b-e367588c635c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:46.202471 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3b6e003f-3ccc-4341-a94b-e367588c635c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1313 microversion: 2.1 time: 0.223697 May 25 15:42:46.203047 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 206/411] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:45 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:46.371315 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7c7a3c0f-8526-4dd9-8ff6-3adc051e856c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:46.372496 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7c7a3c0f-8526-4dd9-8ff6-3adc051e856c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:46.379632 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7c7a3c0f-8526-4dd9-8ff6-3adc051e856c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:46.380211 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7c7a3c0f-8526-4dd9-8ff6-3adc051e856c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:46.381103 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7c7a3c0f-8526-4dd9-8ff6-3adc051e856c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:46.381560 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7c7a3c0f-8526-4dd9-8ff6-3adc051e856c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:46.564177 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-90cf9f5d-e7bf-4ac9-a608-05d5af8b7b58 req-d7bc0d11-c5be-46cb-b6d8-a07689aef37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f388fe6-4e89-48f0-bf54-e1ff840faed9", "name": "network-vif-plugged", "status": "completed", "tag": "36833437-89ff-4bb3-978e-a332e89af2e5"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:46.566759 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:42:46.566759 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:42:46.575730 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-90cf9f5d-e7bf-4ac9-a608-05d5af8b7b58 req-d7bc0d11-c5be-46cb-b6d8-a07689aef37f service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:46.576220 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-90cf9f5d-e7bf-4ac9-a608-05d5af8b7b58 req-d7bc0d11-c5be-46cb-b6d8-a07689aef37f service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:46.585561 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7c7a3c0f-8526-4dd9-8ff6-3adc051e856c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:46.592593 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-90cf9f5d-e7bf-4ac9-a608-05d5af8b7b58 req-d7bc0d11-c5be-46cb-b6d8-a07689aef37f service nova] Creating event network-vif-plugged:36833437-89ff-4bb3-978e-a332e89af2e5 for instance 3f388fe6-4e89-48f0-bf54-e1ff840faed9 on hv-cinder-79123 May 25 15:42:46.594305 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7c7a3c0f-8526-4dd9-8ff6-3adc051e856c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.227318 May 25 15:42:46.601913 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 206/412] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:46 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:46.604946 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-90cf9f5d-e7bf-4ac9-a608-05d5af8b7b58 req-d7bc0d11-c5be-46cb-b6d8-a07689aef37f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044704 May 25 15:42:46.605538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 207/413] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:42:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:42:46.673246 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:46.673865 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:46.681724 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:46.682174 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:46.682943 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:46.683382 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:46.846331 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c5f6793a-3022-4f36-ac50-b4c097bf3abb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:46.847960 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c5f6793a-3022-4f36-ac50-b4c097bf3abb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:46.856526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c5f6793a-3022-4f36-ac50-b4c097bf3abb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:46.857260 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c5f6793a-3022-4f36-ac50-b4c097bf3abb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:46.858074 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c5f6793a-3022-4f36-ac50-b4c097bf3abb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:46.858668 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c5f6793a-3022-4f36-ac50-b4c097bf3abb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:46.891821 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:46.905297 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:46.907046 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:46.908195 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.238668 May 25 15:42:46.909393 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 207/414] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:46 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:47.091137 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c5f6793a-3022-4f36-ac50-b4c097bf3abb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:47.100415 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c5f6793a-3022-4f36-ac50-b4c097bf3abb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.258540 May 25 15:42:47.100987 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 208/415] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:46 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:47.219944 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-602a87d2-1049-4f98-a78d-443d5fcf183c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:47.220574 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-602a87d2-1049-4f98-a78d-443d5fcf183c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:47.228402 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-602a87d2-1049-4f98-a78d-443d5fcf183c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:47.228861 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-602a87d2-1049-4f98-a78d-443d5fcf183c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:47.229642 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-602a87d2-1049-4f98-a78d-443d5fcf183c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:47.230086 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-602a87d2-1049-4f98-a78d-443d5fcf183c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:47.430134 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-602a87d2-1049-4f98-a78d-443d5fcf183c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:47.438372 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-602a87d2-1049-4f98-a78d-443d5fcf183c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1313 microversion: 2.1 time: 0.222094 May 25 15:42:47.438949 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 208/416] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:47 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:47.611648 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f752b289-9db1-4846-9ad5-88c2bfa73bce tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:47.612309 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f752b289-9db1-4846-9ad5-88c2bfa73bce tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:47.620417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f752b289-9db1-4846-9ad5-88c2bfa73bce tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:47.620930 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f752b289-9db1-4846-9ad5-88c2bfa73bce tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:47.621767 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f752b289-9db1-4846-9ad5-88c2bfa73bce tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:47.622223 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f752b289-9db1-4846-9ad5-88c2bfa73bce tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:47.822854 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f752b289-9db1-4846-9ad5-88c2bfa73bce tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:47.831792 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f752b289-9db1-4846-9ad5-88c2bfa73bce tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.224000 May 25 15:42:47.832398 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 209/417] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:47 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:47.927302 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4abb8437-f78a-4468-9a29-87bbe7374996 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:47.927963 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4abb8437-f78a-4468-9a29-87bbe7374996 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:47.935291 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4abb8437-f78a-4468-9a29-87bbe7374996 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:47.935746 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4abb8437-f78a-4468-9a29-87bbe7374996 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:47.936557 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4abb8437-f78a-4468-9a29-87bbe7374996 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:47.936996 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4abb8437-f78a-4468-9a29-87bbe7374996 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:48.117908 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e5ddcc95-0768-423d-ae84-a07a443cc79b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:48.118658 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e5ddcc95-0768-423d-ae84-a07a443cc79b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:48.125969 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e5ddcc95-0768-423d-ae84-a07a443cc79b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:48.126431 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e5ddcc95-0768-423d-ae84-a07a443cc79b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:48.127222 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e5ddcc95-0768-423d-ae84-a07a443cc79b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:48.127671 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e5ddcc95-0768-423d-ae84-a07a443cc79b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:48.133228 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4abb8437-f78a-4468-9a29-87bbe7374996 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:48.142339 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4abb8437-f78a-4468-9a29-87bbe7374996 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:48.143899 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4abb8437-f78a-4468-9a29-87bbe7374996 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:48.145118 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4abb8437-f78a-4468-9a29-87bbe7374996 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.222427 May 25 15:42:48.145670 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 209/418] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:47 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:48.324249 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e5ddcc95-0768-423d-ae84-a07a443cc79b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:48.333064 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e5ddcc95-0768-423d-ae84-a07a443cc79b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.218820 May 25 15:42:48.333642 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 210/419] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:48 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:48.455810 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-28b26fa2-6fc6-42af-b4fb-e7e79c8973cf tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:48.456379 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-28b26fa2-6fc6-42af-b4fb-e7e79c8973cf tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:48.464686 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-28b26fa2-6fc6-42af-b4fb-e7e79c8973cf tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:48.465153 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-28b26fa2-6fc6-42af-b4fb-e7e79c8973cf tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:48.466033 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-28b26fa2-6fc6-42af-b4fb-e7e79c8973cf tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:48.467440 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-28b26fa2-6fc6-42af-b4fb-e7e79c8973cf tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:48.669873 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-28b26fa2-6fc6-42af-b4fb-e7e79c8973cf tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:48.678342 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-28b26fa2-6fc6-42af-b4fb-e7e79c8973cf tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1313 microversion: 2.1 time: 0.226462 May 25 15:42:48.678915 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 210/420] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:48 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:48.848607 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0153f90f-e568-4f1a-859b-f0625f3df9f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:48.849223 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0153f90f-e568-4f1a-859b-f0625f3df9f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:48.856511 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0153f90f-e568-4f1a-859b-f0625f3df9f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:48.856969 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0153f90f-e568-4f1a-859b-f0625f3df9f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:48.857735 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0153f90f-e568-4f1a-859b-f0625f3df9f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:48.858172 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0153f90f-e568-4f1a-859b-f0625f3df9f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:49.058782 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0153f90f-e568-4f1a-859b-f0625f3df9f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:49.068618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0153f90f-e568-4f1a-859b-f0625f3df9f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.223716 May 25 15:42:49.069280 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 211/421] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:48 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:49.162704 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d72f7137-03f8-41c6-a7d9-2b21d2677065 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:49.163324 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d72f7137-03f8-41c6-a7d9-2b21d2677065 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:49.170963 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d72f7137-03f8-41c6-a7d9-2b21d2677065 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:49.171521 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d72f7137-03f8-41c6-a7d9-2b21d2677065 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:49.172407 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d72f7137-03f8-41c6-a7d9-2b21d2677065 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:49.172853 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d72f7137-03f8-41c6-a7d9-2b21d2677065 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:49.350011 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5a9f15b3-53d1-4cca-95c0-729c022af6c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:49.350833 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5a9f15b3-53d1-4cca-95c0-729c022af6c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:49.358141 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a9f15b3-53d1-4cca-95c0-729c022af6c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:49.358598 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a9f15b3-53d1-4cca-95c0-729c022af6c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:49.359380 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a9f15b3-53d1-4cca-95c0-729c022af6c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:49.359833 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a9f15b3-53d1-4cca-95c0-729c022af6c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:49.366766 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d72f7137-03f8-41c6-a7d9-2b21d2677065 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:49.375572 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d72f7137-03f8-41c6-a7d9-2b21d2677065 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:49.377314 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d72f7137-03f8-41c6-a7d9-2b21d2677065 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:49.378483 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d72f7137-03f8-41c6-a7d9-2b21d2677065 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.219857 May 25 15:42:49.379935 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 211/422] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:49 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:49.569258 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5a9f15b3-53d1-4cca-95c0-729c022af6c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:49.578138 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5a9f15b3-53d1-4cca-95c0-729c022af6c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.231657 May 25 15:42:49.578901 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 212/423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:49 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:49.694443 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-70785dfa-43ce-43ee-9e5d-9806c7e17e12 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:49.695071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-70785dfa-43ce-43ee-9e5d-9806c7e17e12 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:49.702377 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-70785dfa-43ce-43ee-9e5d-9806c7e17e12 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:49.702835 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-70785dfa-43ce-43ee-9e5d-9806c7e17e12 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:49.703616 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-70785dfa-43ce-43ee-9e5d-9806c7e17e12 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:49.704102 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-70785dfa-43ce-43ee-9e5d-9806c7e17e12 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:49.903930 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-70785dfa-43ce-43ee-9e5d-9806c7e17e12 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:49.912562 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-70785dfa-43ce-43ee-9e5d-9806c7e17e12 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1498 microversion: 2.1 time: 0.221771 May 25 15:42:49.913126 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 212/424] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:49 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1498 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:50.086114 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ea1dbe23-9f94-4358-895a-0731eefecddf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:50.086841 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ea1dbe23-9f94-4358-895a-0731eefecddf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:50.094156 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ea1dbe23-9f94-4358-895a-0731eefecddf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:50.094622 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ea1dbe23-9f94-4358-895a-0731eefecddf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:50.095410 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ea1dbe23-9f94-4358-895a-0731eefecddf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:50.095881 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ea1dbe23-9f94-4358-895a-0731eefecddf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:50.293465 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ea1dbe23-9f94-4358-895a-0731eefecddf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:50.302263 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ea1dbe23-9f94-4358-895a-0731eefecddf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.220523 May 25 15:42:50.302843 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 213/425] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:50 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:50.399179 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:50.399900 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:50.407011 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:50.407475 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:50.408345 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:50.408798 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:50.594715 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-02cd9cd5-2917-4173-b050-9674702e5d43 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:50.595376 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-02cd9cd5-2917-4173-b050-9674702e5d43 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:50.603022 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02cd9cd5-2917-4173-b050-9674702e5d43 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:50.603764 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02cd9cd5-2917-4173-b050-9674702e5d43 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:50.604339 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02cd9cd5-2917-4173-b050-9674702e5d43 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:50.604778 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02cd9cd5-2917-4173-b050-9674702e5d43 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:50.611484 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:50.621825 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:50.623453 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:50.625061 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1746 microversion: 2.20 time: 0.230949 May 25 15:42:50.625652 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 213/426] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:50 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1746 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:50.814022 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-02cd9cd5-2917-4173-b050-9674702e5d43 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:50.824066 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-02cd9cd5-2917-4173-b050-9674702e5d43 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.233207 May 25 15:42:50.824659 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 214/427] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:50 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:51.080395 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:51.080913 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:51.088223 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:51.088683 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:51.089464 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:51.089935 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:51.150338 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Going to try to terminate instance {{(pid=112576) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:42:51.272284 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 204 len: 0 microversion: 2.1 time: 0.195190 May 25 15:42:51.276100 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 214/428] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:42:51 2021] DELETE /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:42:51.281376 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0089847d-1030-40ca-b174-fd695429b3c5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:51.282015 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0089847d-1030-40ca-b174-fd695429b3c5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:51.289894 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0089847d-1030-40ca-b174-fd695429b3c5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:51.290356 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0089847d-1030-40ca-b174-fd695429b3c5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:51.291133 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0089847d-1030-40ca-b174-fd695429b3c5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:51.291575 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0089847d-1030-40ca-b174-fd695429b3c5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:51.319003 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-670d2182-4567-43e1-ae45-9a17978d4a4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:51.319708 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-670d2182-4567-43e1-ae45-9a17978d4a4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:51.327478 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-670d2182-4567-43e1-ae45-9a17978d4a4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:51.327957 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-670d2182-4567-43e1-ae45-9a17978d4a4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:51.328730 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-670d2182-4567-43e1-ae45-9a17978d4a4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:51.329175 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-670d2182-4567-43e1-ae45-9a17978d4a4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:51.490219 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0089847d-1030-40ca-b174-fd695429b3c5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:51.498450 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0089847d-1030-40ca-b174-fd695429b3c5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1504 microversion: 2.1 time: 0.221315 May 25 15:42:51.499030 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 215/429] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:51 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:51.529720 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-670d2182-4567-43e1-ae45-9a17978d4a4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:51.539213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-670d2182-4567-43e1-ae45-9a17978d4a4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.224374 May 25 15:42:51.539918 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 215/430] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:51 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:51.644841 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5971a298-dd72-433a-b15e-626dce746fde tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:51.645499 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5971a298-dd72-433a-b15e-626dce746fde tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:51.652843 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5971a298-dd72-433a-b15e-626dce746fde tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:51.653300 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5971a298-dd72-433a-b15e-626dce746fde tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:51.654079 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5971a298-dd72-433a-b15e-626dce746fde tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:51.654524 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5971a298-dd72-433a-b15e-626dce746fde tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:51.840496 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5b094cd7-66dd-4487-a6ba-38e9604b91b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:51.841242 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5b094cd7-66dd-4487-a6ba-38e9604b91b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:51.848543 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5b094cd7-66dd-4487-a6ba-38e9604b91b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:51.849008 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5b094cd7-66dd-4487-a6ba-38e9604b91b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:51.849796 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5b094cd7-66dd-4487-a6ba-38e9604b91b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:51.850242 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5b094cd7-66dd-4487-a6ba-38e9604b91b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:51.853394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5971a298-dd72-433a-b15e-626dce746fde tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:51.862174 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5971a298-dd72-433a-b15e-626dce746fde tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:51.863761 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5971a298-dd72-433a-b15e-626dce746fde tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:51.865044 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5971a298-dd72-433a-b15e-626dce746fde tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1746 microversion: 2.20 time: 0.224616 May 25 15:42:51.865711 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 216/431] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:51 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1746 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:52.109852 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5b094cd7-66dd-4487-a6ba-38e9604b91b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:52.118500 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5b094cd7-66dd-4487-a6ba-38e9604b91b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.281714 May 25 15:42:52.119071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 216/432] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:51 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:52.515434 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7673cba6-ce58-43a2-9c55-1dc71425a8a9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:52.516117 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7673cba6-ce58-43a2-9c55-1dc71425a8a9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:52.523993 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7673cba6-ce58-43a2-9c55-1dc71425a8a9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:52.524458 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7673cba6-ce58-43a2-9c55-1dc71425a8a9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:52.525249 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7673cba6-ce58-43a2-9c55-1dc71425a8a9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:52.525698 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7673cba6-ce58-43a2-9c55-1dc71425a8a9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:52.555992 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4b72c7e3-da97-4a4a-948a-bf7fe4a49831 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:52.556619 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4b72c7e3-da97-4a4a-948a-bf7fe4a49831 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:52.563799 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4b72c7e3-da97-4a4a-948a-bf7fe4a49831 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:52.564283 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4b72c7e3-da97-4a4a-948a-bf7fe4a49831 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:52.565096 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4b72c7e3-da97-4a4a-948a-bf7fe4a49831 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:52.565537 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4b72c7e3-da97-4a4a-948a-bf7fe4a49831 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:52.723655 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7673cba6-ce58-43a2-9c55-1dc71425a8a9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:52.732253 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7673cba6-ce58-43a2-9c55-1dc71425a8a9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1504 microversion: 2.1 time: 0.220469 May 25 15:42:52.732880 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 217/433] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:52 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:52.742361 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-1da50195-e4ad-4d9c-b917-6c7cc7b32468 req-19f9fbd5-7107-422a-b0e3-a237b4bdc144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9301f1db-ecb0-465b-858c-64a2bfd4d5cb", "name": "network-vif-plugged", "status": "completed", "tag": "3f734a1c-be04-4203-b351-6b0b6785f9ae"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:52.744613 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:42:52.744613 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:42:52.755303 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-1da50195-e4ad-4d9c-b917-6c7cc7b32468 req-19f9fbd5-7107-422a-b0e3-a237b4bdc144 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:52.755761 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-1da50195-e4ad-4d9c-b917-6c7cc7b32468 req-19f9fbd5-7107-422a-b0e3-a237b4bdc144 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:52.769931 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4b72c7e3-da97-4a4a-948a-bf7fe4a49831 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:52.772624 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-1da50195-e4ad-4d9c-b917-6c7cc7b32468 req-19f9fbd5-7107-422a-b0e3-a237b4bdc144 service nova] Creating event network-vif-plugged:3f734a1c-be04-4203-b351-6b0b6785f9ae for instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb on hv-cinder-79123 May 25 15:42:52.777667 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-1da50195-e4ad-4d9c-b917-6c7cc7b32468 req-19f9fbd5-7107-422a-b0e3-a237b4bdc144 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043541 May 25 15:42:52.778301 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 218/434] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:42:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:42:52.778705 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4b72c7e3-da97-4a4a-948a-bf7fe4a49831 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.226350 May 25 15:42:52.779267 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 217/435] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:52 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:52.884873 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:52.885837 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:52.895568 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:52.895997 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:52.896780 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:52.897215 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:53.103286 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:53.112195 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:53.114233 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:53.115390 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1741 microversion: 2.20 time: 0.234829 May 25 15:42:53.124087 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 219/436] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:52 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:53.135405 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-762cff27-1dc4-43b0-907e-4c3751f04305 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:53.136385 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-762cff27-1dc4-43b0-907e-4c3751f04305 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:53.143377 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-762cff27-1dc4-43b0-907e-4c3751f04305 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:53.143828 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-762cff27-1dc4-43b0-907e-4c3751f04305 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:53.144665 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-762cff27-1dc4-43b0-907e-4c3751f04305 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:53.145102 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-762cff27-1dc4-43b0-907e-4c3751f04305 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:53.351718 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-762cff27-1dc4-43b0-907e-4c3751f04305 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:53.360745 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-762cff27-1dc4-43b0-907e-4c3751f04305 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.228911 May 25 15:42:53.361335 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 218/437] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:53 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:53.749300 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2e67ac92-8aa7-46d2-a863-18f6bf8f3742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:53.750016 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2e67ac92-8aa7-46d2-a863-18f6bf8f3742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:53.758004 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2e67ac92-8aa7-46d2-a863-18f6bf8f3742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:53.758743 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2e67ac92-8aa7-46d2-a863-18f6bf8f3742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:53.759776 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2e67ac92-8aa7-46d2-a863-18f6bf8f3742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:53.760696 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2e67ac92-8aa7-46d2-a863-18f6bf8f3742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:53.795534 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bbcffc59-3368-4d0c-94a0-9c477b3b5ca3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:53.796537 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bbcffc59-3368-4d0c-94a0-9c477b3b5ca3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:53.805675 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bbcffc59-3368-4d0c-94a0-9c477b3b5ca3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:53.806490 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bbcffc59-3368-4d0c-94a0-9c477b3b5ca3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:53.815554 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bbcffc59-3368-4d0c-94a0-9c477b3b5ca3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:53.816724 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bbcffc59-3368-4d0c-94a0-9c477b3b5ca3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:53.993403 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2e67ac92-8aa7-46d2-a863-18f6bf8f3742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:54.005246 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2e67ac92-8aa7-46d2-a863-18f6bf8f3742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1504 microversion: 2.1 time: 0.259296 May 25 15:42:54.015555 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 220/438] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:53 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:54.093862 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-bbcffc59-3368-4d0c-94a0-9c477b3b5ca3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:54.103683 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bbcffc59-3368-4d0c-94a0-9c477b3b5ca3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.311789 May 25 15:42:54.104551 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 219/439] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:53 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:54.134412 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2f42e8be-030b-4f88-8389-c76a28d71552 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:54.135393 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2f42e8be-030b-4f88-8389-c76a28d71552 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:54.150741 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f42e8be-030b-4f88-8389-c76a28d71552 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:54.151193 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f42e8be-030b-4f88-8389-c76a28d71552 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:54.152006 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f42e8be-030b-4f88-8389-c76a28d71552 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:54.152444 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f42e8be-030b-4f88-8389-c76a28d71552 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:54.387953 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2f42e8be-030b-4f88-8389-c76a28d71552 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:54.390900 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-869dc3f6-2dad-4739-8645-a3541e46435d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:54.391559 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-869dc3f6-2dad-4739-8645-a3541e46435d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:54.395717 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2f42e8be-030b-4f88-8389-c76a28d71552 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:54.397294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2f42e8be-030b-4f88-8389-c76a28d71552 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:54.405336 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2f42e8be-030b-4f88-8389-c76a28d71552 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1741 microversion: 2.20 time: 0.275313 May 25 15:42:54.406231 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 221/440] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:54 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1741 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:42:54.407030 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-869dc3f6-2dad-4739-8645-a3541e46435d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:54.407625 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-869dc3f6-2dad-4739-8645-a3541e46435d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:54.408499 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-869dc3f6-2dad-4739-8645-a3541e46435d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:54.408962 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-869dc3f6-2dad-4739-8645-a3541e46435d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:54.648583 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-869dc3f6-2dad-4739-8645-a3541e46435d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:54.665192 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-869dc3f6-2dad-4739-8645-a3541e46435d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.272131 May 25 15:42:54.676135 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 220/441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:54 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:55.027955 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3618a645-b958-4959-b119-42bc0dd2f367 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:55.029334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3618a645-b958-4959-b119-42bc0dd2f367 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:55.038454 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3618a645-b958-4959-b119-42bc0dd2f367 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:55.039180 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3618a645-b958-4959-b119-42bc0dd2f367 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:55.042724 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3618a645-b958-4959-b119-42bc0dd2f367 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:55.043696 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3618a645-b958-4959-b119-42bc0dd2f367 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:55.121960 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b48cd846-f828-42af-a252-60fe7202975e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:55.122862 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b48cd846-f828-42af-a252-60fe7202975e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:55.133922 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b48cd846-f828-42af-a252-60fe7202975e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:55.134861 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b48cd846-f828-42af-a252-60fe7202975e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:55.136143 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b48cd846-f828-42af-a252-60fe7202975e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:55.137344 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b48cd846-f828-42af-a252-60fe7202975e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:55.392431 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b48cd846-f828-42af-a252-60fe7202975e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:55.405581 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b48cd846-f828-42af-a252-60fe7202975e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.287400 May 25 15:42:55.415823 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 221/442] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:55 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:55.429445 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:55.430929 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:55.437222 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3618a645-b958-4959-b119-42bc0dd2f367 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:55.447269 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:55.449633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:55.449633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:55.450183 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:55.455493 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3618a645-b958-4959-b119-42bc0dd2f367 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1504 microversion: 2.1 time: 0.433002 May 25 15:42:55.467496 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 222/443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:55 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:55.689044 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-044f3476-4369-4685-81d5-e273ecbfa98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:55.690168 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-044f3476-4369-4685-81d5-e273ecbfa98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:55.701634 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-044f3476-4369-4685-81d5-e273ecbfa98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:55.702337 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-044f3476-4369-4685-81d5-e273ecbfa98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:55.703729 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-044f3476-4369-4685-81d5-e273ecbfa98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:55.704366 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-044f3476-4369-4685-81d5-e273ecbfa98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:55.755008 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:55.768706 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:55.771498 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:55.772900 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1741 microversion: 2.20 time: 0.350905 May 25 15:42:55.783997 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 222/444] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:55 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1741 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:55.789660 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-cec38009-9877-4708-a8d4-9487dc097e00 req-ed3ee174-1786-4008-94ce-00a6ef96276e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f388fe6-4e89-48f0-bf54-e1ff840faed9", "name": "network-vif-deleted", "tag": "36833437-89ff-4bb3-978e-a332e89af2e5"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:55.791270 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:42:55.791270 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:42:55.799845 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-cec38009-9877-4708-a8d4-9487dc097e00 req-ed3ee174-1786-4008-94ce-00a6ef96276e service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:55.800410 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-cec38009-9877-4708-a8d4-9487dc097e00 req-ed3ee174-1786-4008-94ce-00a6ef96276e service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:55.817571 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-cec38009-9877-4708-a8d4-9487dc097e00 req-ed3ee174-1786-4008-94ce-00a6ef96276e service nova] Creating event network-vif-deleted:36833437-89ff-4bb3-978e-a332e89af2e5 for instance 3f388fe6-4e89-48f0-bf54-e1ff840faed9 on hv-cinder-79123 May 25 15:42:55.822985 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-cec38009-9877-4708-a8d4-9487dc097e00 req-ed3ee174-1786-4008-94ce-00a6ef96276e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036890 May 25 15:42:55.828670 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 223/445] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:42:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:42:56.030625 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-044f3476-4369-4685-81d5-e273ecbfa98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:56.040834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-044f3476-4369-4685-81d5-e273ecbfa98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.360911 May 25 15:42:56.041428 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 223/446] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:55 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:56.423156 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0fbdbfbf-7fce-4e15-a8f2-3de0de31e7de tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:56.424744 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0fbdbfbf-7fce-4e15-a8f2-3de0de31e7de tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:56.458272 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0fbdbfbf-7fce-4e15-a8f2-3de0de31e7de tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:56.458272 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0fbdbfbf-7fce-4e15-a8f2-3de0de31e7de tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:56.458272 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0fbdbfbf-7fce-4e15-a8f2-3de0de31e7de tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:56.458272 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0fbdbfbf-7fce-4e15-a8f2-3de0de31e7de tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:56.470808 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:56.471429 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:56.484242 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:56.484703 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:56.485533 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:56.485973 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:56.589445 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:56.589998 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:56.590874 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.objects.instance [None req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lazy-loading 'fault' on Instance uuid 3f388fe6-4e89-48f0-bf54-e1ff840faed9 {{(pid=112577) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:42:56.709693 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:56.720098 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 200 len: 1303 microversion: 2.1 time: 0.252980 May 25 15:42:56.721207 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 224/447] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:56 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 1303 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:56.741694 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-0fbdbfbf-7fce-4e15-a8f2-3de0de31e7de tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:56.753165 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0fbdbfbf-7fce-4e15-a8f2-3de0de31e7de tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.334214 May 25 15:42:56.753784 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 224/448] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:56 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:56.791245 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2d07266c-a42a-405b-9868-158fc0bf2738 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:56.792432 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2d07266c-a42a-405b-9868-158fc0bf2738 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:56.801139 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2d07266c-a42a-405b-9868-158fc0bf2738 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:56.802526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2d07266c-a42a-405b-9868-158fc0bf2738 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:56.803970 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2d07266c-a42a-405b-9868-158fc0bf2738 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:56.804589 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2d07266c-a42a-405b-9868-158fc0bf2738 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:57.053856 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2d07266c-a42a-405b-9868-158fc0bf2738 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:57.058624 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d8df344e-e082-4026-aff5-e1ad5e0ba5a7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:57.059350 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d8df344e-e082-4026-aff5-e1ad5e0ba5a7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:57.063437 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2d07266c-a42a-405b-9868-158fc0bf2738 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:57.065363 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2d07266c-a42a-405b-9868-158fc0bf2738 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:57.066891 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2d07266c-a42a-405b-9868-158fc0bf2738 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1741 microversion: 2.20 time: 0.279473 May 25 15:42:57.077556 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 225/449] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:56 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1741 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:42:57.077752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d8df344e-e082-4026-aff5-e1ad5e0ba5a7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:57.077752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d8df344e-e082-4026-aff5-e1ad5e0ba5a7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:57.077752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d8df344e-e082-4026-aff5-e1ad5e0ba5a7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:57.077752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d8df344e-e082-4026-aff5-e1ad5e0ba5a7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:57.293179 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d8df344e-e082-4026-aff5-e1ad5e0ba5a7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:57.302691 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d8df344e-e082-4026-aff5-e1ad5e0ba5a7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.248147 May 25 15:42:57.304572 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 225/450] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:57 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:57.738659 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-11154db1-77fa-4d1a-8d55-3ad278a9129f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:57.739290 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-11154db1-77fa-4d1a-8d55-3ad278a9129f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 3f388fe6-4e89-48f0-bf54-e1ff840faed9] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:57.746774 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-11154db1-77fa-4d1a-8d55-3ad278a9129f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:57.747231 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-11154db1-77fa-4d1a-8d55-3ad278a9129f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:57.748043 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-11154db1-77fa-4d1a-8d55-3ad278a9129f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:57.748487 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-11154db1-77fa-4d1a-8d55-3ad278a9129f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:57.771027 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-00535a13-4163-4c8d-8bda-4e613284d9d8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:57.772376 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-00535a13-4163-4c8d-8bda-4e613284d9d8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:57.786859 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-00535a13-4163-4c8d-8bda-4e613284d9d8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:57.787958 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-00535a13-4163-4c8d-8bda-4e613284d9d8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:57.788648 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-00535a13-4163-4c8d-8bda-4e613284d9d8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:57.789134 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-00535a13-4163-4c8d-8bda-4e613284d9d8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:57.799469 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-11154db1-77fa-4d1a-8d55-3ad278a9129f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] HTTP exception thrown: Instance 3f388fe6-4e89-48f0-bf54-e1ff840faed9 could not be found. May 25 15:42:57.800132 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-11154db1-77fa-4d1a-8d55-3ad278a9129f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Returning 404 to user: Instance 3f388fe6-4e89-48f0-bf54-e1ff840faed9 could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:42:57.801033 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-11154db1-77fa-4d1a-8d55-3ad278a9129f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9" status: 404 len: 111 microversion: 2.1 time: 0.066378 May 25 15:42:57.812533 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 226/451] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:57 2021] GET /compute/v2.1/servers/3f388fe6-4e89-48f0-bf54-e1ff840faed9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:42:57.864971 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2009959600", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "networks": [{"uuid": "71fe9388-47c1-4797-9687-8ab41ffa2ce9"}]}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:42:58.008080 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-00535a13-4163-4c8d-8bda-4e613284d9d8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:58.017616 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-00535a13-4163-4c8d-8bda-4e613284d9d8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.250979 May 25 15:42:58.020120 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 226/452] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:57 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:58.085293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:58.086301 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:58.093875 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:58.094527 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:58.095539 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:58.095923 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:58.319623 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:58.329011 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:58.330539 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:58.331733 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1741 microversion: 2.20 time: 0.250404 May 25 15:42:58.332563 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 227/453] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:58 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:42:58.346619 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-33445aa2-98ac-4820-80d2-2433b6ed4b99 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:58.347204 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-33445aa2-98ac-4820-80d2-2433b6ed4b99 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:58.354694 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-33445aa2-98ac-4820-80d2-2433b6ed4b99 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:58.355163 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-33445aa2-98ac-4820-80d2-2433b6ed4b99 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:58.356078 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-33445aa2-98ac-4820-80d2-2433b6ed4b99 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:58.356425 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-33445aa2-98ac-4820-80d2-2433b6ed4b99 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:58.587606 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-33445aa2-98ac-4820-80d2-2433b6ed4b99 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:58.598780 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-33445aa2-98ac-4820-80d2-2433b6ed4b99 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.255349 May 25 15:42:58.599820 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 228/454] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:58 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:42:59.037539 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-08d72246-4e4e-4be9-8a14-ccd48e2028d6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:59.038490 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-08d72246-4e4e-4be9-8a14-ccd48e2028d6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:59.046997 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-08d72246-4e4e-4be9-8a14-ccd48e2028d6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:59.047548 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-08d72246-4e4e-4be9-8a14-ccd48e2028d6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:59.048903 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-08d72246-4e4e-4be9-8a14-ccd48e2028d6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:59.049388 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-08d72246-4e4e-4be9-8a14-ccd48e2028d6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:59.273848 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-08d72246-4e4e-4be9-8a14-ccd48e2028d6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:59.288406 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-08d72246-4e4e-4be9-8a14-ccd48e2028d6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.255097 May 25 15:42:59.289752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 229/455] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:59 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:42:59.350282 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:59.351018 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:59.359197 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:59.359666 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:59.360583 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:59.360998 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:59.583966 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:59.592711 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:59.594240 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:59.595390 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1741 microversion: 2.20 time: 0.249493 May 25 15:42:59.595961 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 230/456] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:42:59 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1741 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:42:59.616065 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-85db1467-7f5f-42c1-85d8-9143b5fa237f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:42:59.616699 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-85db1467-7f5f-42c1-85d8-9143b5fa237f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:42:59.624871 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85db1467-7f5f-42c1-85d8-9143b5fa237f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:59.625350 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85db1467-7f5f-42c1-85d8-9143b5fa237f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:59.626176 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85db1467-7f5f-42c1-85d8-9143b5fa237f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:59.626615 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85db1467-7f5f-42c1-85d8-9143b5fa237f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:59.862888 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-85db1467-7f5f-42c1-85d8-9143b5fa237f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:42:59.872934 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-85db1467-7f5f-42c1-85d8-9143b5fa237f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.260651 May 25 15:42:59.873612 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 231/457] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:42:59 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:00.318803 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bb1248f2-885a-4dd7-8f3b-0c51e07c08fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:00.320040 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bb1248f2-885a-4dd7-8f3b-0c51e07c08fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:00.328684 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bb1248f2-885a-4dd7-8f3b-0c51e07c08fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:00.329190 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bb1248f2-885a-4dd7-8f3b-0c51e07c08fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:00.330020 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bb1248f2-885a-4dd7-8f3b-0c51e07c08fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:00.331073 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bb1248f2-885a-4dd7-8f3b-0c51e07c08fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:00.553827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-bb1248f2-885a-4dd7-8f3b-0c51e07c08fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:00.564601 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bb1248f2-885a-4dd7-8f3b-0c51e07c08fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.250244 May 25 15:43:00.573724 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 232/458] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:00 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:00.618058 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:00.619445 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:00.629966 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:00.630524 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:00.631399 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:00.631946 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:00.869014 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:00.879361 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:00.881111 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:00.882443 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1741 microversion: 2.20 time: 0.271660 May 25 15:43:00.893455 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 233/459] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:00 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1741 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:43:00.893455 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3c7a575f-c3a4-4b60-92e5-47787e331117 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:00.893455 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-3c7a575f-c3a4-4b60-92e5-47787e331117 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:00.899541 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3c7a575f-c3a4-4b60-92e5-47787e331117 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:00.900147 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3c7a575f-c3a4-4b60-92e5-47787e331117 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:00.900939 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3c7a575f-c3a4-4b60-92e5-47787e331117 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:00.901371 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3c7a575f-c3a4-4b60-92e5-47787e331117 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:01.126949 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3c7a575f-c3a4-4b60-92e5-47787e331117 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:01.138384 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3c7a575f-c3a4-4b60-92e5-47787e331117 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1722 microversion: 2.1 time: 0.251715 May 25 15:43:01.138979 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 234/460] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:00 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:01.582396 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f9a54e34-4e87-4c21-b71b-d4dfb3b2176e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:01.583791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f9a54e34-4e87-4c21-b71b-d4dfb3b2176e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:01.592535 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f9a54e34-4e87-4c21-b71b-d4dfb3b2176e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:01.593360 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f9a54e34-4e87-4c21-b71b-d4dfb3b2176e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:01.594382 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f9a54e34-4e87-4c21-b71b-d4dfb3b2176e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:01.595044 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f9a54e34-4e87-4c21-b71b-d4dfb3b2176e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:01.802305 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f9a54e34-4e87-4c21-b71b-d4dfb3b2176e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:01.814595 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f9a54e34-4e87-4c21-b71b-d4dfb3b2176e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.236571 May 25 15:43:01.815508 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 235/461] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:01 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:01.901587 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ce013ded-af42-4320-97fc-12d5cc85ad22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:01.902348 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ce013ded-af42-4320-97fc-12d5cc85ad22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:01.915555 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ce013ded-af42-4320-97fc-12d5cc85ad22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:01.922548 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ce013ded-af42-4320-97fc-12d5cc85ad22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:01.923444 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ce013ded-af42-4320-97fc-12d5cc85ad22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:01.923852 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ce013ded-af42-4320-97fc-12d5cc85ad22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:02.319400 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ce013ded-af42-4320-97fc-12d5cc85ad22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:02.345495 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ce013ded-af42-4320-97fc-12d5cc85ad22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:02.345920 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] validate_networks() for [('71fe9388-47c1-4797-9687-8ab41ffa2ce9', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:43:02.347920 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ce013ded-af42-4320-97fc-12d5cc85ad22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:02.349081 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ce013ded-af42-4320-97fc-12d5cc85ad22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1741 microversion: 2.20 time: 0.451679 May 25 15:43:02.360184 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 236/462] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:01 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1741 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:02.369465 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d0e822f1-fb8f-45f2-9f22-c6bd7c20d37f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:02.370106 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d0e822f1-fb8f-45f2-9f22-c6bd7c20d37f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:02.389311 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d0e822f1-fb8f-45f2-9f22-c6bd7c20d37f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:02.389783 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d0e822f1-fb8f-45f2-9f22-c6bd7c20d37f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:02.390748 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d0e822f1-fb8f-45f2-9f22-c6bd7c20d37f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:02.391277 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d0e822f1-fb8f-45f2-9f22-c6bd7c20d37f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:02.650043 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d0e822f1-fb8f-45f2-9f22-c6bd7c20d37f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:02.661717 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d0e822f1-fb8f-45f2-9f22-c6bd7c20d37f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1699 microversion: 2.1 time: 0.310443 May 25 15:43:02.666701 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 237/463] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:02 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1699 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:02.679360 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:02.688642 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:02.689151 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:02.751951 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Going to try to start instance {{(pid=112576) start /opt/stack/nova/nova/compute/api.py:2602}} May 25 15:43:02.849286 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 202 len: 0 microversion: 2.1 time: 0.172970 May 25 15:43:02.853100 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 238/464] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:43:02 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:43:02.858689 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0957d995-1e74-40ab-907d-221398b6e4f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:02.859481 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0957d995-1e74-40ab-907d-221398b6e4f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:02.868522 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0957d995-1e74-40ab-907d-221398b6e4f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:02.868796 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0957d995-1e74-40ab-907d-221398b6e4f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:02.869598 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0957d995-1e74-40ab-907d-221398b6e4f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:02.870055 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0957d995-1e74-40ab-907d-221398b6e4f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:02.998412 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:43:02.998844 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:43:02.999368 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:43:02.999792 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:43:03.000247 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:43:03.018975 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:03.020143 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:03.020998 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:03.021737 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:03.058884 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Getting quotas for project b4d6b8a11a0d4e2c97f55bde6cd2c234. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:43:03.064286 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Getting quotas for user 23958e7697bd4a84b8ec0a7992437036 and project b4d6b8a11a0d4e2c97f55bde6cd2c234. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:43:03.077777 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:43:03.080282 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:43:03.179647 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-660d8b65-2dec-49f5-9e95-f99691f89b87 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.321212 May 25 15:43:03.180671 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 227/465] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:42:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 5323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 15:43:03.185320 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-405123d7-9a2c-44ab-bc91-7eb016cb494a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:03.186495 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-405123d7-9a2c-44ab-bc91-7eb016cb494a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:03.201714 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-405123d7-9a2c-44ab-bc91-7eb016cb494a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:03.202192 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-405123d7-9a2c-44ab-bc91-7eb016cb494a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:03.203009 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-405123d7-9a2c-44ab-bc91-7eb016cb494a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:03.203459 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-405123d7-9a2c-44ab-bc91-7eb016cb494a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:03.313438 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-0957d995-1e74-40ab-907d-221398b6e4f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:03.327194 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0957d995-1e74-40ab-907d-221398b6e4f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.472778 May 25 15:43:03.327963 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 239/466] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:02 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:03.341714 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3f2969a5-5fa6-4b64-8b08-2f86072dc25f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:03.342464 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-3f2969a5-5fa6-4b64-8b08-2f86072dc25f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:03.443008 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3f2969a5-5fa6-4b64-8b08-2f86072dc25f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:03.450674 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3f2969a5-5fa6-4b64-8b08-2f86072dc25f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1214 microversion: 2.1 time: 0.112642 May 25 15:43:03.451249 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 240/467] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:03 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:03.457055 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-578b3f2a-9cef-4014-a7f5-322e048e144f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:03.457662 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-578b3f2a-9cef-4014-a7f5-322e048e144f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:03.467439 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-578b3f2a-9cef-4014-a7f5-322e048e144f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:03.467935 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-578b3f2a-9cef-4014-a7f5-322e048e144f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:03.468689 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-578b3f2a-9cef-4014-a7f5-322e048e144f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:03.469573 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-578b3f2a-9cef-4014-a7f5-322e048e144f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:03.688643 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-578b3f2a-9cef-4014-a7f5-322e048e144f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:03.698322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-578b3f2a-9cef-4014-a7f5-322e048e144f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:03.699838 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-578b3f2a-9cef-4014-a7f5-322e048e144f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:03.701029 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-578b3f2a-9cef-4014-a7f5-322e048e144f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1741 microversion: 2.20 time: 0.248853 May 25 15:43:03.701586 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 241/468] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:03 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1741 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:03.769701 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-405123d7-9a2c-44ab-bc91-7eb016cb494a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:03.778375 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-405123d7-9a2c-44ab-bc91-7eb016cb494a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1708 microversion: 2.1 time: 0.596711 May 25 15:43:03.778949 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 228/469] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:03 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1708 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:04.344028 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2fe5a45a-ed78-4821-82f3-2815c4117f15 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:04.344661 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2fe5a45a-ed78-4821-82f3-2815c4117f15 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:04.352159 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2fe5a45a-ed78-4821-82f3-2815c4117f15 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:04.352615 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2fe5a45a-ed78-4821-82f3-2815c4117f15 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:04.353399 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2fe5a45a-ed78-4821-82f3-2815c4117f15 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:04.353842 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2fe5a45a-ed78-4821-82f3-2815c4117f15 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:04.468031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7b27abf4-4efa-4c3b-9a9b-dbfd49d3328d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:04.468546 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7b27abf4-4efa-4c3b-9a9b-dbfd49d3328d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:04.480508 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7b27abf4-4efa-4c3b-9a9b-dbfd49d3328d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:04.480961 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7b27abf4-4efa-4c3b-9a9b-dbfd49d3328d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:04.481753 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7b27abf4-4efa-4c3b-9a9b-dbfd49d3328d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:04.482188 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7b27abf4-4efa-4c3b-9a9b-dbfd49d3328d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:04.557111 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2fe5a45a-ed78-4821-82f3-2815c4117f15 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:04.566289 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2fe5a45a-ed78-4821-82f3-2815c4117f15 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.225446 May 25 15:43:04.567071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 242/470] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:04 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:04.618510 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7b27abf4-4efa-4c3b-9a9b-dbfd49d3328d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:04.628006 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7b27abf4-4efa-4c3b-9a9b-dbfd49d3328d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1266 microversion: 2.1 time: 0.163964 May 25 15:43:04.629140 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 229/471] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:04 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:04.719707 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:04.720295 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:04.730952 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:04.731423 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:04.732258 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:04.732704 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:04.795560 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a476343e-0650-4d05-a1aa-266b34120de7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:04.796968 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a476343e-0650-4d05-a1aa-266b34120de7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:04.806664 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a476343e-0650-4d05-a1aa-266b34120de7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:04.807673 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a476343e-0650-4d05-a1aa-266b34120de7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:04.809116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a476343e-0650-4d05-a1aa-266b34120de7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:04.809727 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a476343e-0650-4d05-a1aa-266b34120de7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:04.946714 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:04.955559 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:04.957209 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:04.958359 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1723 microversion: 2.20 time: 0.242539 May 25 15:43:04.958909 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 243/472] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:04 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:05.075886 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a476343e-0650-4d05-a1aa-266b34120de7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:05.087840 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a476343e-0650-4d05-a1aa-266b34120de7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1708 microversion: 2.1 time: 0.296282 May 25 15:43:05.089837 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 230/473] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:04 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1708 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:05.584594 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-cbed41d5-6d53-4505-a268-1f38362c701a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:05.585231 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-cbed41d5-6d53-4505-a268-1f38362c701a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:05.592596 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cbed41d5-6d53-4505-a268-1f38362c701a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:05.593064 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cbed41d5-6d53-4505-a268-1f38362c701a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:05.593855 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cbed41d5-6d53-4505-a268-1f38362c701a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:05.594305 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cbed41d5-6d53-4505-a268-1f38362c701a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:05.646966 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e12d1b62-f5cc-4da8-91d4-98b0bccb1990 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:05.647773 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e12d1b62-f5cc-4da8-91d4-98b0bccb1990 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:05.657442 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e12d1b62-f5cc-4da8-91d4-98b0bccb1990 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:05.658931 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e12d1b62-f5cc-4da8-91d4-98b0bccb1990 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:05.660908 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e12d1b62-f5cc-4da8-91d4-98b0bccb1990 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:05.661937 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e12d1b62-f5cc-4da8-91d4-98b0bccb1990 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:05.827441 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e12d1b62-f5cc-4da8-91d4-98b0bccb1990 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:05.831410 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-cbed41d5-6d53-4505-a268-1f38362c701a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:05.840430 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-cbed41d5-6d53-4505-a268-1f38362c701a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.261509 May 25 15:43:05.841247 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 244/474] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:05 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:05.842497 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e12d1b62-f5cc-4da8-91d4-98b0bccb1990 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1272 microversion: 2.1 time: 0.199216 May 25 15:43:05.843076 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 231/475] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:05 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:05.976561 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-44db4336-f07c-406c-a591-57d43dcf2549 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:05.977178 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-44db4336-f07c-406c-a591-57d43dcf2549 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:05.984305 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-44db4336-f07c-406c-a591-57d43dcf2549 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:05.984808 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-44db4336-f07c-406c-a591-57d43dcf2549 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:05.985588 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-44db4336-f07c-406c-a591-57d43dcf2549 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:05.986057 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-44db4336-f07c-406c-a591-57d43dcf2549 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:06.107468 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d55ce148-a8a9-42c7-b432-367aa8dd4d41 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:06.108085 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d55ce148-a8a9-42c7-b432-367aa8dd4d41 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:06.116510 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d55ce148-a8a9-42c7-b432-367aa8dd4d41 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:06.116978 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d55ce148-a8a9-42c7-b432-367aa8dd4d41 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:06.117780 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d55ce148-a8a9-42c7-b432-367aa8dd4d41 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:06.118290 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d55ce148-a8a9-42c7-b432-367aa8dd4d41 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:06.187973 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-44db4336-f07c-406c-a591-57d43dcf2549 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:06.196713 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-44db4336-f07c-406c-a591-57d43dcf2549 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:06.198229 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-44db4336-f07c-406c-a591-57d43dcf2549 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:06.199364 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-44db4336-f07c-406c-a591-57d43dcf2549 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1723 microversion: 2.20 time: 0.227112 May 25 15:43:06.200127 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 245/476] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:05 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:06.483044 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d55ce148-a8a9-42c7-b432-367aa8dd4d41 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:06.492785 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d55ce148-a8a9-42c7-b432-367aa8dd4d41 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1712 microversion: 2.1 time: 0.389184 May 25 15:43:06.493715 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 232/477] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:06 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1712 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:06.612759 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-ad18bcf8-93e9-44b8-a472-68085f612aa5 req-4d326ebd-a0af-44a5-8a7c-136a85564b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9301f1db-ecb0-465b-858c-64a2bfd4d5cb", "name": "network-vif-unplugged", "status": "completed", "tag": "3f734a1c-be04-4203-b351-6b0b6785f9ae"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:06.616514 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:43:06.616514 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:43:06.628552 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-ad18bcf8-93e9-44b8-a472-68085f612aa5 req-4d326ebd-a0af-44a5-8a7c-136a85564b1c service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:06.629016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-ad18bcf8-93e9-44b8-a472-68085f612aa5 req-4d326ebd-a0af-44a5-8a7c-136a85564b1c service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:06.647335 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-ad18bcf8-93e9-44b8-a472-68085f612aa5 req-4d326ebd-a0af-44a5-8a7c-136a85564b1c service nova] Creating event network-vif-unplugged:3f734a1c-be04-4203-b351-6b0b6785f9ae for instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb on hv-cinder-79123 May 25 15:43:06.652786 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-ad18bcf8-93e9-44b8-a472-68085f612aa5 req-4d326ebd-a0af-44a5-8a7c-136a85564b1c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043667 May 25 15:43:06.653383 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 246/478] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:43:06 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:43:06.857271 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a7c97d39-b261-4c36-9fc5-71221ba6c3c4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:06.858506 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a7c97d39-b261-4c36-9fc5-71221ba6c3c4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:06.859846 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8ea1ac86-6779-43f7-8061-8634efbed3c4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:06.860588 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8ea1ac86-6779-43f7-8061-8634efbed3c4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:06.866670 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a7c97d39-b261-4c36-9fc5-71221ba6c3c4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:06.867137 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a7c97d39-b261-4c36-9fc5-71221ba6c3c4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:06.867958 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a7c97d39-b261-4c36-9fc5-71221ba6c3c4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:06.868124 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8ea1ac86-6779-43f7-8061-8634efbed3c4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:06.868407 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a7c97d39-b261-4c36-9fc5-71221ba6c3c4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:06.868765 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8ea1ac86-6779-43f7-8061-8634efbed3c4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:06.869559 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8ea1ac86-6779-43f7-8061-8634efbed3c4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:06.870010 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8ea1ac86-6779-43f7-8061-8634efbed3c4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:07.075326 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8ea1ac86-6779-43f7-8061-8634efbed3c4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:07.083667 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8ea1ac86-6779-43f7-8061-8634efbed3c4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1314 microversion: 2.1 time: 0.227834 May 25 15:43:07.084493 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 247/479] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:06 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:07.217927 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-92685032-9561-4278-aff9-3b79f353198c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:07.218874 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-92685032-9561-4278-aff9-3b79f353198c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:07.226447 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-92685032-9561-4278-aff9-3b79f353198c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:07.226913 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-92685032-9561-4278-aff9-3b79f353198c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:07.227708 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-92685032-9561-4278-aff9-3b79f353198c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:07.228204 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-92685032-9561-4278-aff9-3b79f353198c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:07.430646 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-92685032-9561-4278-aff9-3b79f353198c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:07.439387 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-92685032-9561-4278-aff9-3b79f353198c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:07.441444 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-92685032-9561-4278-aff9-3b79f353198c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:07.442602 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-92685032-9561-4278-aff9-3b79f353198c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1723 microversion: 2.20 time: 0.228564 May 25 15:43:07.443167 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 248/480] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:07 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:43:07.456228 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a7c97d39-b261-4c36-9fc5-71221ba6c3c4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:07.465569 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a7c97d39-b261-4c36-9fc5-71221ba6c3c4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.612295 May 25 15:43:07.466145 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 233/481] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:06 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:07.845828 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-69d57db8-885e-4273-bb8c-35b35dbc1469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79e4fd0b-1392-4753-92e7-bab6790baa22", "tag": "b85f42e2-6150-40d8-a0ac-30b059e7807b"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:07.848581 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:43:07.848581 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:43:07.865525 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-69d57db8-885e-4273-bb8c-35b35dbc1469 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:07.866165 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-69d57db8-885e-4273-bb8c-35b35dbc1469 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:07.890839 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-69d57db8-885e-4273-bb8c-35b35dbc1469 service nova] Creating event network-changed:b85f42e2-6150-40d8-a0ac-30b059e7807b for instance 79e4fd0b-1392-4753-92e7-bab6790baa22 on hv-cinder-79123 May 25 15:43:07.897207 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-69d57db8-885e-4273-bb8c-35b35dbc1469 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055379 May 25 15:43:07.897820 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 249/482] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:43:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:43:08.100442 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9b6a5adc-a13e-444a-b656-6eeb65292dab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:08.101073 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9b6a5adc-a13e-444a-b656-6eeb65292dab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:08.108442 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b6a5adc-a13e-444a-b656-6eeb65292dab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:08.108910 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b6a5adc-a13e-444a-b656-6eeb65292dab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:08.109735 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b6a5adc-a13e-444a-b656-6eeb65292dab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:08.110163 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b6a5adc-a13e-444a-b656-6eeb65292dab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:08.461525 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8f6ec3e0-50db-4201-8d1c-6137742dba08 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:08.462257 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8f6ec3e0-50db-4201-8d1c-6137742dba08 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:08.469822 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f6ec3e0-50db-4201-8d1c-6137742dba08 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:08.470283 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f6ec3e0-50db-4201-8d1c-6137742dba08 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:08.471071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f6ec3e0-50db-4201-8d1c-6137742dba08 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:08.471521 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f6ec3e0-50db-4201-8d1c-6137742dba08 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:08.676280 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8f6ec3e0-50db-4201-8d1c-6137742dba08 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:08.685235 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8f6ec3e0-50db-4201-8d1c-6137742dba08 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:08.686845 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8f6ec3e0-50db-4201-8d1c-6137742dba08 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:08.688051 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8f6ec3e0-50db-4201-8d1c-6137742dba08 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1723 microversion: 2.20 time: 0.231575 May 25 15:43:08.688625 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 250/483] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:08 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:43:08.694457 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-df4d4484-c971-4186-a9f7-deb439190b8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:08.695749 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-df4d4484-c971-4186-a9f7-deb439190b8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:08.705432 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-df4d4484-c971-4186-a9f7-deb439190b8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:08.705900 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-df4d4484-c971-4186-a9f7-deb439190b8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:08.706761 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-df4d4484-c971-4186-a9f7-deb439190b8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:08.707195 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-df4d4484-c971-4186-a9f7-deb439190b8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:08.749270 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9b6a5adc-a13e-444a-b656-6eeb65292dab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:08.760596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9b6a5adc-a13e-444a-b656-6eeb65292dab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1314 microversion: 2.1 time: 0.664391 May 25 15:43:08.762594 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 234/484] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:08 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:08.911168 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-df4d4484-c971-4186-a9f7-deb439190b8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:08.920382 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-df4d4484-c971-4186-a9f7-deb439190b8f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.230309 May 25 15:43:08.921384 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 251/485] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:08 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:09.174659 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1292618565", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-980388926", "security_groups": [{"name": "tempest-secgroup-smoke-1147553235"}], "block_device_mapping_v2": [{"uuid": "98e8b9cb-fbe2-42aa-a04d-b39c00c671eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d8a04926-b628-40fa-a53b-51df7783813d"}]}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:09.392964 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] validate_networks() for [('d8a04926-b628-40fa-a53b-51df7783813d', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:43:09.711767 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4fafd203-ab97-4432-8d1b-81a4618d98bd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:09.723386 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4fafd203-ab97-4432-8d1b-81a4618d98bd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:09.730863 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4fafd203-ab97-4432-8d1b-81a4618d98bd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:09.731398 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4fafd203-ab97-4432-8d1b-81a4618d98bd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:09.732213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4fafd203-ab97-4432-8d1b-81a4618d98bd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:09.732683 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4fafd203-ab97-4432-8d1b-81a4618d98bd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:09.927325 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4fafd203-ab97-4432-8d1b-81a4618d98bd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:09.940016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4fafd203-ab97-4432-8d1b-81a4618d98bd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:09.941602 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4fafd203-ab97-4432-8d1b-81a4618d98bd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:09.943255 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4fafd203-ab97-4432-8d1b-81a4618d98bd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1726 microversion: 2.20 time: 0.239295 May 25 15:43:09.943826 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 252/486] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:09 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1726 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:09.948244 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ff0129b0-a2d7-46df-bbfb-8fd52a1eb669 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:09.948814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ff0129b0-a2d7-46df-bbfb-8fd52a1eb669 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:09.956727 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ff0129b0-a2d7-46df-bbfb-8fd52a1eb669 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:09.957550 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ff0129b0-a2d7-46df-bbfb-8fd52a1eb669 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:09.958346 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ff0129b0-a2d7-46df-bbfb-8fd52a1eb669 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:09.958793 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ff0129b0-a2d7-46df-bbfb-8fd52a1eb669 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:10.170370 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ff0129b0-a2d7-46df-bbfb-8fd52a1eb669 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:10.179031 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ff0129b0-a2d7-46df-bbfb-8fd52a1eb669 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1314 microversion: 2.1 time: 0.234186 May 25 15:43:10.179606 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 253/487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:09 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:10.183925 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:43:10.184343 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-85231995-3e56-4633-bd2e-eed0b8a2d0f4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:10.184611 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:43:10.184817 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-85231995-3e56-4633-bd2e-eed0b8a2d0f4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:10.185337 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:43:10.185864 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:43:10.186389 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:43:10.191854 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85231995-3e56-4633-bd2e-eed0b8a2d0f4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:10.192345 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85231995-3e56-4633-bd2e-eed0b8a2d0f4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:10.193141 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85231995-3e56-4633-bd2e-eed0b8a2d0f4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:10.193589 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85231995-3e56-4633-bd2e-eed0b8a2d0f4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:10.194900 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:10.195360 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:10.196205 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:10.196645 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:10.214285 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Getting quotas for project 8dff1003ceba47f6a75b4c3901343b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:43:10.218065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Getting quotas for user 082a0ad3211940cda30d219bb251e2fe and project 8dff1003ceba47f6a75b4c3901343b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:43:10.319658 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:43:10.321873 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98e8b9cb-fbe2-42aa-a04d-b39c00c671eb',volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:43:10.391176 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-85231995-3e56-4633-bd2e-eed0b8a2d0f4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:10.400456 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-85231995-3e56-4633-bd2e-eed0b8a2d0f4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.219781 May 25 15:43:10.401061 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 254/488] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:10 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:10.405584 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-40e07195-9a45-471a-9e62-ca260229eeba tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aec917a3-6fe8-46b5-895a-ad640bed22d9"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:10.406698 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-40e07195-9a45-471a-9e62-ca260229eeba tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:10.414560 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-40e07195-9a45-471a-9e62-ca260229eeba tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:10.415027 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-40e07195-9a45-471a-9e62-ca260229eeba tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:10.415851 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-40e07195-9a45-471a-9e62-ca260229eeba tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:10.416320 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-40e07195-9a45-471a-9e62-ca260229eeba tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:10.496176 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-978dddcc-6192-4323-bcbc-d03aefc004cd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.325411 May 25 15:43:10.497010 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 235/489] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:43:09 2021] POST /compute/v2.1/servers => generated 406 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:43:10.506664 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-bd48399a-1e5f-494f-9313-ba1bb96b2120 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:10.507293 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-bd48399a-1e5f-494f-9313-ba1bb96b2120 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:10.585157 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-bd48399a-1e5f-494f-9313-ba1bb96b2120 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:10.594839 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-bd48399a-1e5f-494f-9313-ba1bb96b2120 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1094 microversion: 2.1 time: 0.091677 May 25 15:43:10.595243 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 236/490] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:10 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1094 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:10.867531 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-40e07195-9a45-471a-9e62-ca260229eeba tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.465375 May 25 15:43:10.868191 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 255/491] 10.222.0.36 () {62 vars in 1364 bytes} [Tue May 25 15:43:10 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/os-volume_attachments => generated 188 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:43:10.973018 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:10.974008 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:10.981771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:10.982228 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:10.983009 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:10.983449 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:11.129672 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action" status: 202 len: 0 microversion: 2.20 time: 0.161052 May 25 15:43:11.130473 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 237/492] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:43:10 2021] POST /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:43:11.138858 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f795dded-741b-474e-ae5c-6a02a2a9d9cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:11.140148 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f795dded-741b-474e-ae5c-6a02a2a9d9cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:11.147934 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f795dded-741b-474e-ae5c-6a02a2a9d9cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:11.148391 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f795dded-741b-474e-ae5c-6a02a2a9d9cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:11.149356 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f795dded-741b-474e-ae5c-6a02a2a9d9cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:11.149802 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f795dded-741b-474e-ae5c-6a02a2a9d9cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:11.197287 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e1ed1435-ce2a-46e7-958b-26e78a4a883c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:11.197914 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e1ed1435-ce2a-46e7-958b-26e78a4a883c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:11.205842 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1ed1435-ce2a-46e7-958b-26e78a4a883c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:11.207231 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1ed1435-ce2a-46e7-958b-26e78a4a883c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:11.208417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1ed1435-ce2a-46e7-958b-26e78a4a883c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:11.209020 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1ed1435-ce2a-46e7-958b-26e78a4a883c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:11.358322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f795dded-741b-474e-ae5c-6a02a2a9d9cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:11.370785 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f795dded-741b-474e-ae5c-6a02a2a9d9cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:11.372383 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f795dded-741b-474e-ae5c-6a02a2a9d9cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:11.373976 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f795dded-741b-474e-ae5c-6a02a2a9d9cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1752 microversion: 2.20 time: 0.239354 May 25 15:43:11.375919 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 256/493] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:11 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1752 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:11.418566 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4312fc8a-1f43-4106-a662-db5422a62c5b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:11.419271 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4312fc8a-1f43-4106-a662-db5422a62c5b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:11.424628 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e1ed1435-ce2a-46e7-958b-26e78a4a883c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:11.429667 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4312fc8a-1f43-4106-a662-db5422a62c5b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:11.430123 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4312fc8a-1f43-4106-a662-db5422a62c5b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:11.430906 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4312fc8a-1f43-4106-a662-db5422a62c5b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:11.431344 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4312fc8a-1f43-4106-a662-db5422a62c5b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:11.433971 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e1ed1435-ce2a-46e7-958b-26e78a4a883c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1314 microversion: 2.1 time: 0.240428 May 25 15:43:11.434669 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 238/494] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:11 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:11.611313 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a514961d-c782-4358-b67b-d286c601acbb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:11.612125 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a514961d-c782-4358-b67b-d286c601acbb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:11.620199 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a514961d-c782-4358-b67b-d286c601acbb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:11.620742 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a514961d-c782-4358-b67b-d286c601acbb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:11.621618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a514961d-c782-4358-b67b-d286c601acbb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:11.622148 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a514961d-c782-4358-b67b-d286c601acbb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:11.635083 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4312fc8a-1f43-4106-a662-db5422a62c5b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:11.645353 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4312fc8a-1f43-4106-a662-db5422a62c5b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.231155 May 25 15:43:11.650960 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 257/495] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:11 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:11.839306 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a514961d-c782-4358-b67b-d286c601acbb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:11.848768 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a514961d-c782-4358-b67b-d286c601acbb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1192 microversion: 2.1 time: 0.241225 May 25 15:43:11.849602 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 239/496] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:11 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1192 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:12.392586 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1928c868-d747-422a-95e9-e4f2d5047313 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:12.393136 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1928c868-d747-422a-95e9-e4f2d5047313 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:12.400600 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1928c868-d747-422a-95e9-e4f2d5047313 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:12.401051 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1928c868-d747-422a-95e9-e4f2d5047313 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:12.402027 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1928c868-d747-422a-95e9-e4f2d5047313 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:12.402464 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1928c868-d747-422a-95e9-e4f2d5047313 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:12.452301 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3ca971b7-ed7d-4c7d-bb05-9948fcaed56a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:12.453850 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3ca971b7-ed7d-4c7d-bb05-9948fcaed56a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:12.461397 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3ca971b7-ed7d-4c7d-bb05-9948fcaed56a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:12.462027 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3ca971b7-ed7d-4c7d-bb05-9948fcaed56a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:12.464756 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3ca971b7-ed7d-4c7d-bb05-9948fcaed56a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:12.465502 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3ca971b7-ed7d-4c7d-bb05-9948fcaed56a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:12.666009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1928c868-d747-422a-95e9-e4f2d5047313 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:12.675962 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1928c868-d747-422a-95e9-e4f2d5047313 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:12.677641 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1928c868-d747-422a-95e9-e4f2d5047313 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:12.679006 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1928c868-d747-422a-95e9-e4f2d5047313 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1754 microversion: 2.20 time: 0.290481 May 25 15:43:12.679566 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 258/497] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:12 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1754 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:12.684250 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-761aebfc-13fb-4b31-a893-2d5f1adf9675 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:12.685051 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-761aebfc-13fb-4b31-a893-2d5f1adf9675 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:12.693465 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-761aebfc-13fb-4b31-a893-2d5f1adf9675 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:12.693924 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-761aebfc-13fb-4b31-a893-2d5f1adf9675 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:12.694862 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-761aebfc-13fb-4b31-a893-2d5f1adf9675 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:12.695300 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-761aebfc-13fb-4b31-a893-2d5f1adf9675 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:12.884351 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3ca971b7-ed7d-4c7d-bb05-9948fcaed56a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:12.895567 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3ca971b7-ed7d-4c7d-bb05-9948fcaed56a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1314 microversion: 2.1 time: 0.448516 May 25 15:43:12.912638 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 240/498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:12 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:12.922294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-37c0ec6e-7060-41ba-a800-980b1c3dba64 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:12.923383 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-37c0ec6e-7060-41ba-a800-980b1c3dba64 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:12.933771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-37c0ec6e-7060-41ba-a800-980b1c3dba64 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:12.936158 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-37c0ec6e-7060-41ba-a800-980b1c3dba64 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:12.937091 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-37c0ec6e-7060-41ba-a800-980b1c3dba64 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:12.939065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-37c0ec6e-7060-41ba-a800-980b1c3dba64 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:13.054378 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-761aebfc-13fb-4b31-a893-2d5f1adf9675 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:13.067576 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-761aebfc-13fb-4b31-a893-2d5f1adf9675 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.386468 May 25 15:43:13.068300 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 259/499] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:12 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:13.480159 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-37c0ec6e-7060-41ba-a800-980b1c3dba64 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:13.489377 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-37c0ec6e-7060-41ba-a800-980b1c3dba64 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1278 microversion: 2.1 time: 0.575292 May 25 15:43:13.490051 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 241/500] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:12 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1278 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:13.698375 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-aed2a543-3c6d-4527-878f-81ce2db456f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:13.699425 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-aed2a543-3c6d-4527-878f-81ce2db456f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:13.707493 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aed2a543-3c6d-4527-878f-81ce2db456f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:13.708257 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aed2a543-3c6d-4527-878f-81ce2db456f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:13.709052 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aed2a543-3c6d-4527-878f-81ce2db456f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:13.709499 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aed2a543-3c6d-4527-878f-81ce2db456f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:13.914417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9d54fe24-3e49-4a1c-92b8-891121e92150 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:13.916109 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9d54fe24-3e49-4a1c-92b8-891121e92150 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:13.933280 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d54fe24-3e49-4a1c-92b8-891121e92150 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:13.933744 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d54fe24-3e49-4a1c-92b8-891121e92150 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:13.934551 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d54fe24-3e49-4a1c-92b8-891121e92150 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:13.934997 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d54fe24-3e49-4a1c-92b8-891121e92150 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:13.951947 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-aed2a543-3c6d-4527-878f-81ce2db456f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:13.968838 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-aed2a543-3c6d-4527-878f-81ce2db456f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:13.970598 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-aed2a543-3c6d-4527-878f-81ce2db456f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:13.972691 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-aed2a543-3c6d-4527-878f-81ce2db456f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1754 microversion: 2.20 time: 0.278319 May 25 15:43:13.973888 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 260/501] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:13 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1754 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:14.084885 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-80ea177c-92a3-4871-84bf-50a6338d577b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:14.086365 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-80ea177c-92a3-4871-84bf-50a6338d577b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:14.095031 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-80ea177c-92a3-4871-84bf-50a6338d577b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:14.095608 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-80ea177c-92a3-4871-84bf-50a6338d577b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:14.096501 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-80ea177c-92a3-4871-84bf-50a6338d577b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:14.097171 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-80ea177c-92a3-4871-84bf-50a6338d577b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:14.316374 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-80ea177c-92a3-4871-84bf-50a6338d577b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:14.327001 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-80ea177c-92a3-4871-84bf-50a6338d577b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.246303 May 25 15:43:14.327612 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 261/502] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:14 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:14.332946 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-03bec78b-60fc-413e-926a-b474954c7a72 req-fe93e7ea-3480-4301-96c6-c14fd99ebc5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd52975-28c3-4fb7-ada2-905a8a9c571f", "tag": "746ae7a8-06cf-478c-b6d4-ecf4e9c02988"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:14.334951 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:43:14.334951 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:43:14.349233 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9d54fe24-3e49-4a1c-92b8-891121e92150 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:14.351749 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-03bec78b-60fc-413e-926a-b474954c7a72 req-fe93e7ea-3480-4301-96c6-c14fd99ebc5d service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:14.352259 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-03bec78b-60fc-413e-926a-b474954c7a72 req-fe93e7ea-3480-4301-96c6-c14fd99ebc5d service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:14.357999 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9d54fe24-3e49-4a1c-92b8-891121e92150 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1314 microversion: 2.1 time: 0.448688 May 25 15:43:14.359934 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 242/503] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:13 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:14.369936 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-03bec78b-60fc-413e-926a-b474954c7a72 req-fe93e7ea-3480-4301-96c6-c14fd99ebc5d service nova] Creating event network-changed:746ae7a8-06cf-478c-b6d4-ecf4e9c02988 for instance 4cd52975-28c3-4fb7-ada2-905a8a9c571f on hv-cinder-79123 May 25 15:43:14.375655 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-03bec78b-60fc-413e-926a-b474954c7a72 req-fe93e7ea-3480-4301-96c6-c14fd99ebc5d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046590 May 25 15:43:14.376401 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 262/504] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:43:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:43:14.506557 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1c0a94f8-f413-4c5c-bad8-54cd3cf3421e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:14.507529 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1c0a94f8-f413-4c5c-bad8-54cd3cf3421e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:14.515721 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1c0a94f8-f413-4c5c-bad8-54cd3cf3421e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:14.516405 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1c0a94f8-f413-4c5c-bad8-54cd3cf3421e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:14.517524 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1c0a94f8-f413-4c5c-bad8-54cd3cf3421e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:14.518080 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1c0a94f8-f413-4c5c-bad8-54cd3cf3421e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:14.738760 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-c20a94b5-a199-46ec-a0d1-8515df88e920 req-b520e84e-7c6a-4cbd-b1af-9612ef4618fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e4fd0b-1392-4753-92e7-bab6790baa22", "name": "network-vif-plugged", "status": "completed", "tag": "b85f42e2-6150-40d8-a0ac-30b059e7807b"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:14.741464 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:43:14.741464 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:43:14.750819 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-c20a94b5-a199-46ec-a0d1-8515df88e920 req-b520e84e-7c6a-4cbd-b1af-9612ef4618fb service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:14.751485 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-c20a94b5-a199-46ec-a0d1-8515df88e920 req-b520e84e-7c6a-4cbd-b1af-9612ef4618fb service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:14.771188 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-c20a94b5-a199-46ec-a0d1-8515df88e920 req-b520e84e-7c6a-4cbd-b1af-9612ef4618fb service nova] Creating event network-vif-plugged:b85f42e2-6150-40d8-a0ac-30b059e7807b for instance 79e4fd0b-1392-4753-92e7-bab6790baa22 on hv-cinder-79123 May 25 15:43:14.776229 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-c20a94b5-a199-46ec-a0d1-8515df88e920 req-b520e84e-7c6a-4cbd-b1af-9612ef4618fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044311 May 25 15:43:14.777472 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 263/505] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:43:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:43:14.837593 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1c0a94f8-f413-4c5c-bad8-54cd3cf3421e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:14.846122 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1c0a94f8-f413-4c5c-bad8-54cd3cf3421e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.343343 May 25 15:43:14.846703 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 243/506] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:14 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:14.991169 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d1aace9a-3876-4df1-8a72-1d12057c5517 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:14.992059 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d1aace9a-3876-4df1-8a72-1d12057c5517 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:14.999573 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d1aace9a-3876-4df1-8a72-1d12057c5517 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:15.000156 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d1aace9a-3876-4df1-8a72-1d12057c5517 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:15.001018 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d1aace9a-3876-4df1-8a72-1d12057c5517 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:15.001534 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d1aace9a-3876-4df1-8a72-1d12057c5517 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:15.207890 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d1aace9a-3876-4df1-8a72-1d12057c5517 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:15.217197 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d1aace9a-3876-4df1-8a72-1d12057c5517 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:15.218763 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d1aace9a-3876-4df1-8a72-1d12057c5517 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:15.220132 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d1aace9a-3876-4df1-8a72-1d12057c5517 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.233162 May 25 15:43:15.220702 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 264/507] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:14 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:15.344151 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e6dab129-5c83-437a-812c-f0336603f691 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:15.344806 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e6dab129-5c83-437a-812c-f0336603f691 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:15.352046 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e6dab129-5c83-437a-812c-f0336603f691 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:15.352506 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e6dab129-5c83-437a-812c-f0336603f691 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:15.353292 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e6dab129-5c83-437a-812c-f0336603f691 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:15.353740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e6dab129-5c83-437a-812c-f0336603f691 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:15.376995 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8f9b3e4c-85a8-45c4-9179-b3352c58c253 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:15.377690 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8f9b3e4c-85a8-45c4-9179-b3352c58c253 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:15.386149 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f9b3e4c-85a8-45c4-9179-b3352c58c253 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:15.386706 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f9b3e4c-85a8-45c4-9179-b3352c58c253 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:15.388000 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f9b3e4c-85a8-45c4-9179-b3352c58c253 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:15.388163 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f9b3e4c-85a8-45c4-9179-b3352c58c253 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:15.592509 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8f9b3e4c-85a8-45c4-9179-b3352c58c253 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:15.601955 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8f9b3e4c-85a8-45c4-9179-b3352c58c253 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1314 microversion: 2.1 time: 0.228606 May 25 15:43:15.602559 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 265/508] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:15 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:15.824755 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e6dab129-5c83-437a-812c-f0336603f691 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:15.834773 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e6dab129-5c83-437a-812c-f0336603f691 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.494458 May 25 15:43:15.835571 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 244/509] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:15 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:15.862431 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f8b7f973-7be4-4c23-96a8-59f2172cd6da tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:15.863710 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f8b7f973-7be4-4c23-96a8-59f2172cd6da tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:15.871129 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f8b7f973-7be4-4c23-96a8-59f2172cd6da tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:15.871593 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f8b7f973-7be4-4c23-96a8-59f2172cd6da tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:15.872422 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f8b7f973-7be4-4c23-96a8-59f2172cd6da tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:15.872867 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f8b7f973-7be4-4c23-96a8-59f2172cd6da tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:16.100677 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f8b7f973-7be4-4c23-96a8-59f2172cd6da tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:16.109024 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f8b7f973-7be4-4c23-96a8-59f2172cd6da tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.250412 May 25 15:43:16.109599 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 266/510] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:15 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:16.237832 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5f0a9789-4107-4fcd-ba50-52fea14346c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:16.238490 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5f0a9789-4107-4fcd-ba50-52fea14346c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:16.245819 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5f0a9789-4107-4fcd-ba50-52fea14346c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:16.246273 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5f0a9789-4107-4fcd-ba50-52fea14346c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:16.247046 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5f0a9789-4107-4fcd-ba50-52fea14346c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:16.247502 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5f0a9789-4107-4fcd-ba50-52fea14346c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:16.618810 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-14e958bb-1923-4390-b0cd-519951df91c0 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:16.619439 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-14e958bb-1923-4390-b0cd-519951df91c0 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:16.627096 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-14e958bb-1923-4390-b0cd-519951df91c0 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:16.627552 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-14e958bb-1923-4390-b0cd-519951df91c0 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:16.629375 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-14e958bb-1923-4390-b0cd-519951df91c0 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:16.629898 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-14e958bb-1923-4390-b0cd-519951df91c0 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:16.740248 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5f0a9789-4107-4fcd-ba50-52fea14346c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:16.749589 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5f0a9789-4107-4fcd-ba50-52fea14346c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:16.751424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5f0a9789-4107-4fcd-ba50-52fea14346c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:16.752638 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5f0a9789-4107-4fcd-ba50-52fea14346c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.518947 May 25 15:43:16.753747 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 245/511] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:16 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:16.834274 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-14e958bb-1923-4390-b0cd-519951df91c0 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:16.842416 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-14e958bb-1923-4390-b0cd-519951df91c0 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1314 microversion: 2.1 time: 0.227561 May 25 15:43:16.843300 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 267/512] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:16 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:16.850631 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-90637701-cb95-465e-95c2-4a92cf529fbc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:16.851334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-90637701-cb95-465e-95c2-4a92cf529fbc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:16.858676 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-90637701-cb95-465e-95c2-4a92cf529fbc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:16.859138 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-90637701-cb95-465e-95c2-4a92cf529fbc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:16.859952 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-90637701-cb95-465e-95c2-4a92cf529fbc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:16.860422 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-90637701-cb95-465e-95c2-4a92cf529fbc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:17.076417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-90637701-cb95-465e-95c2-4a92cf529fbc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:17.085744 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-90637701-cb95-465e-95c2-4a92cf529fbc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.238739 May 25 15:43:17.086305 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 246/513] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:16 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:17.125300 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-adbcd548-2ad3-4523-beaf-f951d15a4387 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:17.126478 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-adbcd548-2ad3-4523-beaf-f951d15a4387 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:17.133981 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-adbcd548-2ad3-4523-beaf-f951d15a4387 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:17.134450 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-adbcd548-2ad3-4523-beaf-f951d15a4387 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:17.135241 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-adbcd548-2ad3-4523-beaf-f951d15a4387 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:17.136144 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-adbcd548-2ad3-4523-beaf-f951d15a4387 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:17.362716 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-adbcd548-2ad3-4523-beaf-f951d15a4387 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:17.373226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-adbcd548-2ad3-4523-beaf-f951d15a4387 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.251597 May 25 15:43:17.383626 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 268/514] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:17 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:17.771522 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4c40ed2e-6978-435e-b700-237d530474a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:17.772284 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4c40ed2e-6978-435e-b700-237d530474a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:17.780128 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4c40ed2e-6978-435e-b700-237d530474a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:17.780834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4c40ed2e-6978-435e-b700-237d530474a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:17.781629 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4c40ed2e-6978-435e-b700-237d530474a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:17.782526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4c40ed2e-6978-435e-b700-237d530474a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:17.859576 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-015e9e91-551b-48d3-8043-552605d03ca6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:17.860358 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-015e9e91-551b-48d3-8043-552605d03ca6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:17.870347 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-015e9e91-551b-48d3-8043-552605d03ca6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:17.870797 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-015e9e91-551b-48d3-8043-552605d03ca6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:17.871583 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-015e9e91-551b-48d3-8043-552605d03ca6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:17.872066 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-015e9e91-551b-48d3-8043-552605d03ca6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:17.990895 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4c40ed2e-6978-435e-b700-237d530474a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:18.001857 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4c40ed2e-6978-435e-b700-237d530474a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:18.004238 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4c40ed2e-6978-435e-b700-237d530474a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:18.005425 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4c40ed2e-6978-435e-b700-237d530474a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.238104 May 25 15:43:18.005988 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 247/515] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:17 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:43:18.086447 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-015e9e91-551b-48d3-8043-552605d03ca6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:18.095062 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-015e9e91-551b-48d3-8043-552605d03ca6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1498 microversion: 2.1 time: 0.239251 May 25 15:43:18.095648 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 269/516] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:17 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:18.102347 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5a8f05cd-c169-4c2b-8977-0462fbb22159 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:18.103245 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5a8f05cd-c169-4c2b-8977-0462fbb22159 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:18.113228 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a8f05cd-c169-4c2b-8977-0462fbb22159 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:18.113914 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a8f05cd-c169-4c2b-8977-0462fbb22159 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:18.114913 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a8f05cd-c169-4c2b-8977-0462fbb22159 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:18.115533 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a8f05cd-c169-4c2b-8977-0462fbb22159 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:18.328789 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5a8f05cd-c169-4c2b-8977-0462fbb22159 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:18.338684 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5a8f05cd-c169-4c2b-8977-0462fbb22159 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.239835 May 25 15:43:18.339333 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 248/517] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:18 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:18.390624 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-86b66b11-026f-4051-956a-44fa40232020 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:18.391355 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-86b66b11-026f-4051-956a-44fa40232020 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:18.399318 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-86b66b11-026f-4051-956a-44fa40232020 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:18.399827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-86b66b11-026f-4051-956a-44fa40232020 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:18.400803 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-86b66b11-026f-4051-956a-44fa40232020 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:18.401307 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-86b66b11-026f-4051-956a-44fa40232020 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:18.614817 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-86b66b11-026f-4051-956a-44fa40232020 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:18.623241 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-86b66b11-026f-4051-956a-44fa40232020 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.236369 May 25 15:43:18.623803 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 270/518] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:18 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:19.024356 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-cafd2787-21f0-4398-84e0-b33c732c765c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:19.025153 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-cafd2787-21f0-4398-84e0-b33c732c765c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:19.032528 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cafd2787-21f0-4398-84e0-b33c732c765c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:19.032987 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cafd2787-21f0-4398-84e0-b33c732c765c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:19.033779 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cafd2787-21f0-4398-84e0-b33c732c765c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:19.034224 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cafd2787-21f0-4398-84e0-b33c732c765c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:19.096036 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a97b21c3-55ba-4148-9b44-b1295da0ac51 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:19.096547 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a97b21c3-55ba-4148-9b44-b1295da0ac51 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:19.104343 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a97b21c3-55ba-4148-9b44-b1295da0ac51 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:19.104805 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a97b21c3-55ba-4148-9b44-b1295da0ac51 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:19.105593 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a97b21c3-55ba-4148-9b44-b1295da0ac51 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:19.106039 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a97b21c3-55ba-4148-9b44-b1295da0ac51 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:19.170567 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a97b21c3-55ba-4148-9b44-b1295da0ac51 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Going to try to terminate instance {{(pid=112576) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:43:19.296382 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a97b21c3-55ba-4148-9b44-b1295da0ac51 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "DELETE /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 204 len: 0 microversion: 2.1 time: 0.203205 May 25 15:43:19.300258 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 271/519] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:43:19 2021] DELETE /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:43:19.306034 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9a95005d-a779-44b2-aaf7-fed7f6e645f4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:19.306757 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9a95005d-a779-44b2-aaf7-fed7f6e645f4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:19.314373 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9a95005d-a779-44b2-aaf7-fed7f6e645f4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:19.314827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9a95005d-a779-44b2-aaf7-fed7f6e645f4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:19.315701 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9a95005d-a779-44b2-aaf7-fed7f6e645f4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:19.316163 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9a95005d-a779-44b2-aaf7-fed7f6e645f4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:19.337622 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cafd2787-21f0-4398-84e0-b33c732c765c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:19.347952 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cafd2787-21f0-4398-84e0-b33c732c765c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:19.349481 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cafd2787-21f0-4398-84e0-b33c732c765c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:19.350637 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-cafd2787-21f0-4398-84e0-b33c732c765c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.330241 May 25 15:43:19.351192 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 249/520] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:19 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:19.366075 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-15a0e3f4-5534-4348-84fd-e6517c59ee3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:19.367043 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-15a0e3f4-5534-4348-84fd-e6517c59ee3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:19.374995 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-15a0e3f4-5534-4348-84fd-e6517c59ee3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:19.375462 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-15a0e3f4-5534-4348-84fd-e6517c59ee3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:19.376280 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-15a0e3f4-5534-4348-84fd-e6517c59ee3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:19.376896 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-15a0e3f4-5534-4348-84fd-e6517c59ee3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:19.535370 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9a95005d-a779-44b2-aaf7-fed7f6e645f4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:19.544243 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9a95005d-a779-44b2-aaf7-fed7f6e645f4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.242280 May 25 15:43:19.545204 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 272/521] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:19 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:19.588694 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-15a0e3f4-5534-4348-84fd-e6517c59ee3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:19.597413 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-15a0e3f4-5534-4348-84fd-e6517c59ee3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.235578 May 25 15:43:19.597991 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 250/522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:19 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:19.641057 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-387666cc-8b42-4280-9ddc-0ff6458832dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:19.642042 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-387666cc-8b42-4280-9ddc-0ff6458832dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:19.650726 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-387666cc-8b42-4280-9ddc-0ff6458832dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:19.651179 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-387666cc-8b42-4280-9ddc-0ff6458832dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:19.651991 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-387666cc-8b42-4280-9ddc-0ff6458832dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:19.652435 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-387666cc-8b42-4280-9ddc-0ff6458832dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:19.854391 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-387666cc-8b42-4280-9ddc-0ff6458832dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:19.863223 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-387666cc-8b42-4280-9ddc-0ff6458832dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.225256 May 25 15:43:19.863912 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 273/523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:19 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:20.371630 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:20.372295 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:20.379747 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:20.380240 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:20.381032 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:20.381482 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:20.561999 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d6eae83d-40a9-4954-acd4-4e6d2bca8119 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:20.562623 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d6eae83d-40a9-4954-acd4-4e6d2bca8119 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:20.570002 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d6eae83d-40a9-4954-acd4-4e6d2bca8119 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:20.570465 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d6eae83d-40a9-4954-acd4-4e6d2bca8119 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:20.571322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d6eae83d-40a9-4954-acd4-4e6d2bca8119 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:20.571762 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d6eae83d-40a9-4954-acd4-4e6d2bca8119 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:20.585364 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:20.595256 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:20.596864 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:20.598545 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.231434 May 25 15:43:20.608213 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 251/524] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:20 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:20.614081 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6e268f1d-9098-47e6-b110-148e4090962c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:20.614889 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6e268f1d-9098-47e6-b110-148e4090962c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:20.622771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6e268f1d-9098-47e6-b110-148e4090962c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:20.623941 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6e268f1d-9098-47e6-b110-148e4090962c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:20.624744 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6e268f1d-9098-47e6-b110-148e4090962c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:20.625226 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6e268f1d-9098-47e6-b110-148e4090962c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:20.777212 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d6eae83d-40a9-4954-acd4-4e6d2bca8119 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:20.789327 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d6eae83d-40a9-4954-acd4-4e6d2bca8119 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.230984 May 25 15:43:20.790547 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 274/525] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:20 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:20.838410 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-6e268f1d-9098-47e6-b110-148e4090962c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:20.847469 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6e268f1d-9098-47e6-b110-148e4090962c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.237048 May 25 15:43:20.849069 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 252/526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:20 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:20.880235 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6ad8d5a7-2237-4038-ba11-591d591a2605 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:20.880817 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6ad8d5a7-2237-4038-ba11-591d591a2605 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:20.888603 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ad8d5a7-2237-4038-ba11-591d591a2605 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:20.889065 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ad8d5a7-2237-4038-ba11-591d591a2605 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:20.889860 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ad8d5a7-2237-4038-ba11-591d591a2605 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:20.890309 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ad8d5a7-2237-4038-ba11-591d591a2605 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:21.090698 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6ad8d5a7-2237-4038-ba11-591d591a2605 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:21.099786 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6ad8d5a7-2237-4038-ba11-591d591a2605 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.223902 May 25 15:43:21.100393 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 275/527] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:20 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:21.616635 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-678f19de-dea0-495c-be7e-127db595db16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:21.617261 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-678f19de-dea0-495c-be7e-127db595db16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:21.626224 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-678f19de-dea0-495c-be7e-127db595db16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:21.626685 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-678f19de-dea0-495c-be7e-127db595db16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:21.627482 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-678f19de-dea0-495c-be7e-127db595db16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:21.627965 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-678f19de-dea0-495c-be7e-127db595db16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:21.807633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-29abad3c-e5e8-4684-b0e8-1d9b98c48fde tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:21.808334 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-29abad3c-e5e8-4684-b0e8-1d9b98c48fde tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:21.820565 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-29abad3c-e5e8-4684-b0e8-1d9b98c48fde tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:21.821030 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-29abad3c-e5e8-4684-b0e8-1d9b98c48fde tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:21.821827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-29abad3c-e5e8-4684-b0e8-1d9b98c48fde tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:21.822270 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-29abad3c-e5e8-4684-b0e8-1d9b98c48fde tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:21.838275 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-678f19de-dea0-495c-be7e-127db595db16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:21.848747 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-678f19de-dea0-495c-be7e-127db595db16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:21.850459 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-678f19de-dea0-495c-be7e-127db595db16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:21.852157 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-678f19de-dea0-495c-be7e-127db595db16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.239083 May 25 15:43:21.854209 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 253/528] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:21 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:21.865621 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-14c165c4-fde9-4c46-90ad-7030baa08042 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:21.866275 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-14c165c4-fde9-4c46-90ad-7030baa08042 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:21.873537 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-14c165c4-fde9-4c46-90ad-7030baa08042 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:21.873955 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-14c165c4-fde9-4c46-90ad-7030baa08042 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:21.874736 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-14c165c4-fde9-4c46-90ad-7030baa08042 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:21.875178 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-14c165c4-fde9-4c46-90ad-7030baa08042 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:22.036791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-29abad3c-e5e8-4684-b0e8-1d9b98c48fde tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:22.045286 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-29abad3c-e5e8-4684-b0e8-1d9b98c48fde tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.241498 May 25 15:43:22.046060 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 276/529] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:21 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:22.082781 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-14c165c4-fde9-4c46-90ad-7030baa08042 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:22.091685 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-14c165c4-fde9-4c46-90ad-7030baa08042 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.231106 May 25 15:43:22.092284 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 254/530] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:21 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:22.116927 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e2593957-044c-4c12-8dbd-d065675dde84 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:22.117549 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e2593957-044c-4c12-8dbd-d065675dde84 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:22.125046 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e2593957-044c-4c12-8dbd-d065675dde84 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:22.125438 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e2593957-044c-4c12-8dbd-d065675dde84 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:22.126219 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e2593957-044c-4c12-8dbd-d065675dde84 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:22.126662 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e2593957-044c-4c12-8dbd-d065675dde84 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:22.330665 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-e2593957-044c-4c12-8dbd-d065675dde84 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:22.341178 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e2593957-044c-4c12-8dbd-d065675dde84 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.228449 May 25 15:43:22.341756 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 277/531] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:22 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:22.870764 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-154cb7bd-5444-4f8d-8fce-649f50fd333b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:22.871423 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-154cb7bd-5444-4f8d-8fce-649f50fd333b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:22.879039 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-154cb7bd-5444-4f8d-8fce-649f50fd333b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:22.879497 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-154cb7bd-5444-4f8d-8fce-649f50fd333b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:22.880469 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-154cb7bd-5444-4f8d-8fce-649f50fd333b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:22.880916 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-154cb7bd-5444-4f8d-8fce-649f50fd333b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:23.062474 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-59ffa3e0-1b47-4469-90a7-cb251f6c1b00 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:23.063085 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-59ffa3e0-1b47-4469-90a7-cb251f6c1b00 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:23.075226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-59ffa3e0-1b47-4469-90a7-cb251f6c1b00 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:23.075608 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-59ffa3e0-1b47-4469-90a7-cb251f6c1b00 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:23.076784 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-59ffa3e0-1b47-4469-90a7-cb251f6c1b00 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:23.076904 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-59ffa3e0-1b47-4469-90a7-cb251f6c1b00 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:23.085420 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-154cb7bd-5444-4f8d-8fce-649f50fd333b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:23.094703 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-154cb7bd-5444-4f8d-8fce-649f50fd333b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:23.096303 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-154cb7bd-5444-4f8d-8fce-649f50fd333b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:23.098065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-154cb7bd-5444-4f8d-8fce-649f50fd333b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.231187 May 25 15:43:23.098625 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 255/532] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:22 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:23.109399 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5d26f941-c247-422a-9558-40c9d4767536 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:23.109399 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5d26f941-c247-422a-9558-40c9d4767536 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:23.116356 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5d26f941-c247-422a-9558-40c9d4767536 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:23.116817 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5d26f941-c247-422a-9558-40c9d4767536 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:23.128102 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5d26f941-c247-422a-9558-40c9d4767536 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:23.128649 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5d26f941-c247-422a-9558-40c9d4767536 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:23.295797 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-59ffa3e0-1b47-4469-90a7-cb251f6c1b00 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:23.305167 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-59ffa3e0-1b47-4469-90a7-cb251f6c1b00 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.246346 May 25 15:43:23.305951 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 278/533] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:23 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:23.335419 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5d26f941-c247-422a-9558-40c9d4767536 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:23.344274 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5d26f941-c247-422a-9558-40c9d4767536 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.239604 May 25 15:43:23.344863 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 256/534] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:23 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:23.358436 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3854f250-0b8e-45e4-b221-31af5e14dec5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:23.359151 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-3854f250-0b8e-45e4-b221-31af5e14dec5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:23.368187 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3854f250-0b8e-45e4-b221-31af5e14dec5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:23.368639 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3854f250-0b8e-45e4-b221-31af5e14dec5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:23.369424 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3854f250-0b8e-45e4-b221-31af5e14dec5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:23.369861 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3854f250-0b8e-45e4-b221-31af5e14dec5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:23.577120 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3854f250-0b8e-45e4-b221-31af5e14dec5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:23.587824 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3854f250-0b8e-45e4-b221-31af5e14dec5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.233140 May 25 15:43:23.595141 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 279/535] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:23 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:24.117197 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4f6389c9-581f-44ba-af3e-54ecb2309bbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:24.117832 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4f6389c9-581f-44ba-af3e-54ecb2309bbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:24.125388 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4f6389c9-581f-44ba-af3e-54ecb2309bbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:24.125855 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4f6389c9-581f-44ba-af3e-54ecb2309bbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:24.126675 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4f6389c9-581f-44ba-af3e-54ecb2309bbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:24.127123 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4f6389c9-581f-44ba-af3e-54ecb2309bbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:24.322213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8a3c9732-5966-4410-a181-43344305fe38 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:24.322828 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8a3c9732-5966-4410-a181-43344305fe38 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:24.330702 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8a3c9732-5966-4410-a181-43344305fe38 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:24.331194 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8a3c9732-5966-4410-a181-43344305fe38 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:24.332017 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8a3c9732-5966-4410-a181-43344305fe38 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:24.332460 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8a3c9732-5966-4410-a181-43344305fe38 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:24.341183 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4f6389c9-581f-44ba-af3e-54ecb2309bbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:24.351671 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4f6389c9-581f-44ba-af3e-54ecb2309bbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:24.353496 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4f6389c9-581f-44ba-af3e-54ecb2309bbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:24.354653 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4f6389c9-581f-44ba-af3e-54ecb2309bbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.241256 May 25 15:43:24.355525 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 257/536] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:24 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:24.363350 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e12c1c2e-f94b-4371-a1c3-bbd211eac839 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:24.364260 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e12c1c2e-f94b-4371-a1c3-bbd211eac839 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:24.372751 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e12c1c2e-f94b-4371-a1c3-bbd211eac839 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:24.373162 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e12c1c2e-f94b-4371-a1c3-bbd211eac839 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:24.374092 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e12c1c2e-f94b-4371-a1c3-bbd211eac839 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:24.374535 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e12c1c2e-f94b-4371-a1c3-bbd211eac839 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:24.539092 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8a3c9732-5966-4410-a181-43344305fe38 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:24.548191 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8a3c9732-5966-4410-a181-43344305fe38 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.229584 May 25 15:43:24.548911 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 280/537] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:24 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:24.583117 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e12c1c2e-f94b-4371-a1c3-bbd211eac839 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:24.591788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e12c1c2e-f94b-4371-a1c3-bbd211eac839 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.233521 May 25 15:43:24.592418 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 258/538] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:24 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:24.603648 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-dea96270-52d0-4916-9040-3f70db60c7ad tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:24.604376 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-dea96270-52d0-4916-9040-3f70db60c7ad tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:24.611707 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dea96270-52d0-4916-9040-3f70db60c7ad tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:24.612200 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dea96270-52d0-4916-9040-3f70db60c7ad tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:24.613074 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dea96270-52d0-4916-9040-3f70db60c7ad tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:24.613511 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dea96270-52d0-4916-9040-3f70db60c7ad tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:24.872687 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-dea96270-52d0-4916-9040-3f70db60c7ad tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:24.881759 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-dea96270-52d0-4916-9040-3f70db60c7ad tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.281653 May 25 15:43:24.882329 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 281/539] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:24 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:25.375644 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5b9d9b41-5334-4b31-891e-6cf7acf538cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:25.377209 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5b9d9b41-5334-4b31-891e-6cf7acf538cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:25.386126 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5b9d9b41-5334-4b31-891e-6cf7acf538cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:25.386584 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5b9d9b41-5334-4b31-891e-6cf7acf538cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:25.387366 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5b9d9b41-5334-4b31-891e-6cf7acf538cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:25.387799 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5b9d9b41-5334-4b31-891e-6cf7acf538cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:25.566789 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a238758d-5c86-4f64-8106-a453cccf3eda tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:25.567403 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a238758d-5c86-4f64-8106-a453cccf3eda tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:25.575075 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a238758d-5c86-4f64-8106-a453cccf3eda tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:25.575549 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a238758d-5c86-4f64-8106-a453cccf3eda tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:25.576388 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a238758d-5c86-4f64-8106-a453cccf3eda tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:25.576846 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a238758d-5c86-4f64-8106-a453cccf3eda tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:25.591743 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5b9d9b41-5334-4b31-891e-6cf7acf538cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:25.600978 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5b9d9b41-5334-4b31-891e-6cf7acf538cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:25.602524 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5b9d9b41-5334-4b31-891e-6cf7acf538cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:25.603665 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5b9d9b41-5334-4b31-891e-6cf7acf538cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.232974 May 25 15:43:25.604358 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 259/540] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:25 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:25.609971 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0a48df6b-70ad-41e1-bf03-f0def3e31d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:25.609971 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0a48df6b-70ad-41e1-bf03-f0def3e31d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:25.617178 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0a48df6b-70ad-41e1-bf03-f0def3e31d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:25.617727 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0a48df6b-70ad-41e1-bf03-f0def3e31d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:25.618641 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0a48df6b-70ad-41e1-bf03-f0def3e31d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:25.619091 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0a48df6b-70ad-41e1-bf03-f0def3e31d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:25.788115 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a238758d-5c86-4f64-8106-a453cccf3eda tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:25.796560 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a238758d-5c86-4f64-8106-a453cccf3eda tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.234117 May 25 15:43:25.807913 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 282/541] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:25 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:25.829394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0a48df6b-70ad-41e1-bf03-f0def3e31d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:25.838298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0a48df6b-70ad-41e1-bf03-f0def3e31d5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.232942 May 25 15:43:25.839085 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 260/542] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:25 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:25.898505 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-eb67d06c-9a7e-417e-a18c-dd8a5d651652 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:25.899136 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-eb67d06c-9a7e-417e-a18c-dd8a5d651652 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:25.906480 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb67d06c-9a7e-417e-a18c-dd8a5d651652 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:25.906948 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb67d06c-9a7e-417e-a18c-dd8a5d651652 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:25.907801 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb67d06c-9a7e-417e-a18c-dd8a5d651652 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:25.908213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb67d06c-9a7e-417e-a18c-dd8a5d651652 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:26.108187 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-eb67d06c-9a7e-417e-a18c-dd8a5d651652 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:26.117220 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-eb67d06c-9a7e-417e-a18c-dd8a5d651652 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.222400 May 25 15:43:26.117814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 283/543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:25 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:26.622148 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-200ce340-9122-495d-bc8a-7fbd632873ed tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:26.622879 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-200ce340-9122-495d-bc8a-7fbd632873ed tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:26.630773 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-200ce340-9122-495d-bc8a-7fbd632873ed tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:26.631246 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-200ce340-9122-495d-bc8a-7fbd632873ed tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:26.632047 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-200ce340-9122-495d-bc8a-7fbd632873ed tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:26.632489 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-200ce340-9122-495d-bc8a-7fbd632873ed tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:26.818048 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-87f3a1c7-986d-4b58-8029-9ad9145a519b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:26.818765 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-87f3a1c7-986d-4b58-8029-9ad9145a519b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:26.827110 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87f3a1c7-986d-4b58-8029-9ad9145a519b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:26.827579 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87f3a1c7-986d-4b58-8029-9ad9145a519b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:26.828411 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87f3a1c7-986d-4b58-8029-9ad9145a519b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:26.828865 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87f3a1c7-986d-4b58-8029-9ad9145a519b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:26.835567 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-200ce340-9122-495d-bc8a-7fbd632873ed tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:26.852301 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-200ce340-9122-495d-bc8a-7fbd632873ed tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:26.853835 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-200ce340-9122-495d-bc8a-7fbd632873ed tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:26.854997 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-200ce340-9122-495d-bc8a-7fbd632873ed tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.236596 May 25 15:43:26.855559 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 261/544] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:26 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:26.859942 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5ede7900-dcac-4e99-a30e-631079ca6cd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:26.860563 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5ede7900-dcac-4e99-a30e-631079ca6cd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:26.868470 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5ede7900-dcac-4e99-a30e-631079ca6cd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:26.868929 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5ede7900-dcac-4e99-a30e-631079ca6cd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:26.869714 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5ede7900-dcac-4e99-a30e-631079ca6cd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:26.870162 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5ede7900-dcac-4e99-a30e-631079ca6cd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:27.035736 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-87f3a1c7-986d-4b58-8029-9ad9145a519b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:27.044366 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-87f3a1c7-986d-4b58-8029-9ad9145a519b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.231116 May 25 15:43:27.044953 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 284/545] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:26 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:27.075414 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5ede7900-dcac-4e99-a30e-631079ca6cd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:27.085105 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5ede7900-dcac-4e99-a30e-631079ca6cd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.228438 May 25 15:43:27.085683 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 262/546] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:26 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:27.134550 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-482ccf50-3e4c-4527-817b-c93f973d5dee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:27.135171 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-482ccf50-3e4c-4527-817b-c93f973d5dee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:27.144310 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-482ccf50-3e4c-4527-817b-c93f973d5dee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:27.144772 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-482ccf50-3e4c-4527-817b-c93f973d5dee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:27.145651 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-482ccf50-3e4c-4527-817b-c93f973d5dee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:27.146129 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-482ccf50-3e4c-4527-817b-c93f973d5dee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:27.346517 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-482ccf50-3e4c-4527-817b-c93f973d5dee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:27.355454 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-482ccf50-3e4c-4527-817b-c93f973d5dee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.224971 May 25 15:43:27.356298 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 285/547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:27 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:27.874038 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2c8cedec-fe85-4978-9993-95786b35ca3c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:27.874656 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2c8cedec-fe85-4978-9993-95786b35ca3c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:27.882570 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2c8cedec-fe85-4978-9993-95786b35ca3c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:27.883027 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2c8cedec-fe85-4978-9993-95786b35ca3c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:27.883799 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2c8cedec-fe85-4978-9993-95786b35ca3c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:27.884266 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2c8cedec-fe85-4978-9993-95786b35ca3c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:28.062010 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9963e2fc-6a5c-4db7-90fc-5c3bcfe3aa02 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:28.062645 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9963e2fc-6a5c-4db7-90fc-5c3bcfe3aa02 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:28.069982 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9963e2fc-6a5c-4db7-90fc-5c3bcfe3aa02 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:28.070372 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9963e2fc-6a5c-4db7-90fc-5c3bcfe3aa02 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:28.071193 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9963e2fc-6a5c-4db7-90fc-5c3bcfe3aa02 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:28.071638 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9963e2fc-6a5c-4db7-90fc-5c3bcfe3aa02 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:28.087393 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2c8cedec-fe85-4978-9993-95786b35ca3c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:28.097569 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2c8cedec-fe85-4978-9993-95786b35ca3c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:28.099287 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2c8cedec-fe85-4978-9993-95786b35ca3c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:28.100457 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2c8cedec-fe85-4978-9993-95786b35ca3c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.230211 May 25 15:43:28.104013 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 263/548] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:27 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:28.108632 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c0b7f9cb-55a9-4673-90d4-b2b6497ba7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:28.109252 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c0b7f9cb-55a9-4673-90d4-b2b6497ba7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:28.118974 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c0b7f9cb-55a9-4673-90d4-b2b6497ba7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:28.119431 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c0b7f9cb-55a9-4673-90d4-b2b6497ba7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:28.120240 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c0b7f9cb-55a9-4673-90d4-b2b6497ba7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:28.120680 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c0b7f9cb-55a9-4673-90d4-b2b6497ba7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:28.279636 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9963e2fc-6a5c-4db7-90fc-5c3bcfe3aa02 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:28.288376 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9963e2fc-6a5c-4db7-90fc-5c3bcfe3aa02 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.230088 May 25 15:43:28.289242 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 286/549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:28 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:28.322938 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c0b7f9cb-55a9-4673-90d4-b2b6497ba7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:28.325076 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:28.326314 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:28.332849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c0b7f9cb-55a9-4673-90d4-b2b6497ba7f9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.227736 May 25 15:43:28.333712 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 264/550] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:28 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:28.336400 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:28.336947 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:28.337756 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:28.338203 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:28.375520 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-de7cb8c8-2323-4ca1-9790-3308d970b8b4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:28.376177 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-de7cb8c8-2323-4ca1-9790-3308d970b8b4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:28.385313 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-de7cb8c8-2323-4ca1-9790-3308d970b8b4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:28.385778 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-de7cb8c8-2323-4ca1-9790-3308d970b8b4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:28.386833 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-de7cb8c8-2323-4ca1-9790-3308d970b8b4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:28.387424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-de7cb8c8-2323-4ca1-9790-3308d970b8b4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:28.511322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/action" status: 202 len: 0 microversion: 2.1 time: 0.189504 May 25 15:43:28.515013 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 287/551] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:43:28 2021] POST /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:43:28.520456 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-63a78148-3bb0-4a32-8596-187dfc17fe42 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:28.521161 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-63a78148-3bb0-4a32-8596-187dfc17fe42 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:28.528583 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-63a78148-3bb0-4a32-8596-187dfc17fe42 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:28.529019 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-63a78148-3bb0-4a32-8596-187dfc17fe42 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:28.529796 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-63a78148-3bb0-4a32-8596-187dfc17fe42 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:28.530396 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-63a78148-3bb0-4a32-8596-187dfc17fe42 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:28.607469 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-de7cb8c8-2323-4ca1-9790-3308d970b8b4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:28.616338 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-de7cb8c8-2323-4ca1-9790-3308d970b8b4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.245487 May 25 15:43:28.616915 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 265/552] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:28 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:28.736431 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-63a78148-3bb0-4a32-8596-187dfc17fe42 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:28.745101 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-63a78148-3bb0-4a32-8596-187dfc17fe42 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1751 microversion: 2.1 time: 0.228669 May 25 15:43:28.745670 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 288/553] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:28 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1751 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:29.119182 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:29.119812 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:29.126960 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:29.127421 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:29.128289 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:29.128754 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:29.305697 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1a4b9781-5561-4537-965f-b851153dcbe8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:29.306428 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1a4b9781-5561-4537-965f-b851153dcbe8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:29.314054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1a4b9781-5561-4537-965f-b851153dcbe8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:29.314540 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1a4b9781-5561-4537-965f-b851153dcbe8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:29.315341 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1a4b9781-5561-4537-965f-b851153dcbe8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:29.315823 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1a4b9781-5561-4537-965f-b851153dcbe8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:29.337640 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:29.348780 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:29.350472 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:29.351646 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.236345 May 25 15:43:29.352244 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 266/554] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:29 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:29.356500 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2193bb60-2e61-45cb-a345-1107c604f8f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:29.357115 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2193bb60-2e61-45cb-a345-1107c604f8f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:29.365480 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2193bb60-2e61-45cb-a345-1107c604f8f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:29.365888 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2193bb60-2e61-45cb-a345-1107c604f8f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:29.366829 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2193bb60-2e61-45cb-a345-1107c604f8f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:29.367281 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2193bb60-2e61-45cb-a345-1107c604f8f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:29.522542 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1a4b9781-5561-4537-965f-b851153dcbe8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:29.532897 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1a4b9781-5561-4537-965f-b851153dcbe8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.231154 May 25 15:43:29.534658 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 289/555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:29 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:29.579891 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2193bb60-2e61-45cb-a345-1107c604f8f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:29.589458 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2193bb60-2e61-45cb-a345-1107c604f8f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.236169 May 25 15:43:29.590047 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 267/556] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:29 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:29.632974 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e55a5401-19f5-4a37-af06-d20ef6edab8d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:29.633629 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e55a5401-19f5-4a37-af06-d20ef6edab8d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:29.641125 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e55a5401-19f5-4a37-af06-d20ef6edab8d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:29.641766 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e55a5401-19f5-4a37-af06-d20ef6edab8d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:29.642541 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e55a5401-19f5-4a37-af06-d20ef6edab8d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:29.642989 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e55a5401-19f5-4a37-af06-d20ef6edab8d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:29.762733 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-63f4b569-c36f-44c2-9fca-c587d519f316 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:29.763401 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-63f4b569-c36f-44c2-9fca-c587d519f316 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:29.771172 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-63f4b569-c36f-44c2-9fca-c587d519f316 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:29.771631 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-63f4b569-c36f-44c2-9fca-c587d519f316 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:29.772475 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-63f4b569-c36f-44c2-9fca-c587d519f316 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:29.772920 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-63f4b569-c36f-44c2-9fca-c587d519f316 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:29.849974 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-e55a5401-19f5-4a37-af06-d20ef6edab8d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:29.859423 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e55a5401-19f5-4a37-af06-d20ef6edab8d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.230175 May 25 15:43:29.860139 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 290/557] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:29 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:30.057354 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-63f4b569-c36f-44c2-9fca-c587d519f316 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:30.066649 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-63f4b569-c36f-44c2-9fca-c587d519f316 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1751 microversion: 2.1 time: 0.307902 May 25 15:43:30.067238 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 268/558] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:29 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1751 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:30.371084 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3e3a0417-7b45-4718-808f-f594cfb9ac10 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:30.371802 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-3e3a0417-7b45-4718-808f-f594cfb9ac10 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:30.379707 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3e3a0417-7b45-4718-808f-f594cfb9ac10 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:30.380204 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3e3a0417-7b45-4718-808f-f594cfb9ac10 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:30.380993 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3e3a0417-7b45-4718-808f-f594cfb9ac10 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:30.381446 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3e3a0417-7b45-4718-808f-f594cfb9ac10 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:30.553645 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7451e136-cba7-49ed-86a6-1eec1345c49c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:30.554265 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7451e136-cba7-49ed-86a6-1eec1345c49c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:30.561819 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7451e136-cba7-49ed-86a6-1eec1345c49c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:30.562573 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7451e136-cba7-49ed-86a6-1eec1345c49c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:30.563364 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7451e136-cba7-49ed-86a6-1eec1345c49c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:30.563799 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7451e136-cba7-49ed-86a6-1eec1345c49c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:30.582733 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3e3a0417-7b45-4718-808f-f594cfb9ac10 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:30.592710 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3e3a0417-7b45-4718-808f-f594cfb9ac10 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:30.594268 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3e3a0417-7b45-4718-808f-f594cfb9ac10 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:30.595460 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3e3a0417-7b45-4718-808f-f594cfb9ac10 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.228347 May 25 15:43:30.596240 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 291/559] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:30 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:30.608674 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8dc88bd0-d0a6-491b-81f6-4b6d1c719a5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:30.609459 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8dc88bd0-d0a6-491b-81f6-4b6d1c719a5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:30.618913 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8dc88bd0-d0a6-491b-81f6-4b6d1c719a5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:30.619520 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8dc88bd0-d0a6-491b-81f6-4b6d1c719a5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:30.620478 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8dc88bd0-d0a6-491b-81f6-4b6d1c719a5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:30.621032 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8dc88bd0-d0a6-491b-81f6-4b6d1c719a5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:30.779969 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7451e136-cba7-49ed-86a6-1eec1345c49c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:30.788736 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7451e136-cba7-49ed-86a6-1eec1345c49c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.239047 May 25 15:43:30.789541 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 269/560] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:30 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:30.832097 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8dc88bd0-d0a6-491b-81f6-4b6d1c719a5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:30.840892 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8dc88bd0-d0a6-491b-81f6-4b6d1c719a5e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.235904 May 25 15:43:30.841466 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 292/561] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:30 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:30.876157 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b3476f5b-c81a-4e02-8bc4-b720a0cbb2e2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:30.876872 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b3476f5b-c81a-4e02-8bc4-b720a0cbb2e2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:30.885513 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b3476f5b-c81a-4e02-8bc4-b720a0cbb2e2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:30.886321 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b3476f5b-c81a-4e02-8bc4-b720a0cbb2e2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:30.887190 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b3476f5b-c81a-4e02-8bc4-b720a0cbb2e2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:30.887713 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b3476f5b-c81a-4e02-8bc4-b720a0cbb2e2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:31.085130 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-75d3ca31-e5aa-48d9-b5ee-d29df1b786d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:31.085799 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-75d3ca31-e5aa-48d9-b5ee-d29df1b786d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:31.089418 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b3476f5b-c81a-4e02-8bc4-b720a0cbb2e2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:31.093271 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-75d3ca31-e5aa-48d9-b5ee-d29df1b786d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:31.093919 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-75d3ca31-e5aa-48d9-b5ee-d29df1b786d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:31.094897 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-75d3ca31-e5aa-48d9-b5ee-d29df1b786d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:31.095348 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-75d3ca31-e5aa-48d9-b5ee-d29df1b786d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:31.099046 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b3476f5b-c81a-4e02-8bc4-b720a0cbb2e2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.226528 May 25 15:43:31.099804 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 270/562] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:30 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:31.301688 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-75d3ca31-e5aa-48d9-b5ee-d29df1b786d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:31.310437 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-75d3ca31-e5aa-48d9-b5ee-d29df1b786d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1751 microversion: 2.1 time: 0.229636 May 25 15:43:31.311009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 293/563] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:31 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1751 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:31.613518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ad563053-50ff-4f88-8718-0e3762d4cbe7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:31.614162 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ad563053-50ff-4f88-8718-0e3762d4cbe7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:31.621816 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ad563053-50ff-4f88-8718-0e3762d4cbe7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:31.622269 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ad563053-50ff-4f88-8718-0e3762d4cbe7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:31.623050 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ad563053-50ff-4f88-8718-0e3762d4cbe7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:31.623485 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ad563053-50ff-4f88-8718-0e3762d4cbe7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:31.806813 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6475c269-af20-400d-85fb-bf54b3f05ca2 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:31.806813 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6475c269-af20-400d-85fb-bf54b3f05ca2 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:31.820219 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6475c269-af20-400d-85fb-bf54b3f05ca2 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:31.820219 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6475c269-af20-400d-85fb-bf54b3f05ca2 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:31.821108 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6475c269-af20-400d-85fb-bf54b3f05ca2 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:31.824376 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6475c269-af20-400d-85fb-bf54b3f05ca2 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:31.830571 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ad563053-50ff-4f88-8718-0e3762d4cbe7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:31.840860 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ad563053-50ff-4f88-8718-0e3762d4cbe7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:31.842391 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ad563053-50ff-4f88-8718-0e3762d4cbe7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:31.843546 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ad563053-50ff-4f88-8718-0e3762d4cbe7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.233955 May 25 15:43:31.844398 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 271/564] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:31 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:43:31.858237 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c60e0eb7-0946-4803-9174-4ea68350c635 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:31.858851 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c60e0eb7-0946-4803-9174-4ea68350c635 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:31.866897 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c60e0eb7-0946-4803-9174-4ea68350c635 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:31.867424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c60e0eb7-0946-4803-9174-4ea68350c635 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:31.868279 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c60e0eb7-0946-4803-9174-4ea68350c635 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:31.868769 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c60e0eb7-0946-4803-9174-4ea68350c635 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:32.024015 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6475c269-af20-400d-85fb-bf54b3f05ca2 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:32.032289 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6475c269-af20-400d-85fb-bf54b3f05ca2 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.229981 May 25 15:43:32.035895 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 294/565] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:31 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:32.082649 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c60e0eb7-0946-4803-9174-4ea68350c635 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:32.091292 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c60e0eb7-0946-4803-9174-4ea68350c635 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.236700 May 25 15:43:32.091879 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 272/566] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:31 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:32.115430 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-32f9da1a-bbd4-4566-bb12-3bfe4fa7a3aa tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:32.116127 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-32f9da1a-bbd4-4566-bb12-3bfe4fa7a3aa tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:32.132109 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-32f9da1a-bbd4-4566-bb12-3bfe4fa7a3aa tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:32.132109 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-32f9da1a-bbd4-4566-bb12-3bfe4fa7a3aa tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:32.132109 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-32f9da1a-bbd4-4566-bb12-3bfe4fa7a3aa tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:32.132109 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-32f9da1a-bbd4-4566-bb12-3bfe4fa7a3aa tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:32.328176 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-04878715-42af-4673-9077-d666b4493d2a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:32.328970 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-04878715-42af-4673-9077-d666b4493d2a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:32.331760 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-32f9da1a-bbd4-4566-bb12-3bfe4fa7a3aa tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:32.337400 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-04878715-42af-4673-9077-d666b4493d2a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:32.338015 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-04878715-42af-4673-9077-d666b4493d2a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:32.338810 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-04878715-42af-4673-9077-d666b4493d2a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:32.339277 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-04878715-42af-4673-9077-d666b4493d2a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:32.340860 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-32f9da1a-bbd4-4566-bb12-3bfe4fa7a3aa tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.229189 May 25 15:43:32.341631 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 295/567] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:32 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:32.553227 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-04878715-42af-4673-9077-d666b4493d2a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:32.562022 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-04878715-42af-4673-9077-d666b4493d2a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1751 microversion: 2.1 time: 0.238018 May 25 15:43:32.562596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 273/568] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:32 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1751 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:32.862009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1afebc46-98a8-4c43-91d9-f478fab0559f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:32.863563 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1afebc46-98a8-4c43-91d9-f478fab0559f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:32.871302 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1afebc46-98a8-4c43-91d9-f478fab0559f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:32.871757 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1afebc46-98a8-4c43-91d9-f478fab0559f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:32.872592 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1afebc46-98a8-4c43-91d9-f478fab0559f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:32.873031 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1afebc46-98a8-4c43-91d9-f478fab0559f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:33.049752 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b5013b27-0ad2-4478-9708-0b62a4b41742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:33.050405 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b5013b27-0ad2-4478-9708-0b62a4b41742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:33.057753 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b5013b27-0ad2-4478-9708-0b62a4b41742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:33.058187 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b5013b27-0ad2-4478-9708-0b62a4b41742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:33.058960 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b5013b27-0ad2-4478-9708-0b62a4b41742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:33.059399 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b5013b27-0ad2-4478-9708-0b62a4b41742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:33.081055 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1afebc46-98a8-4c43-91d9-f478fab0559f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:33.091351 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1afebc46-98a8-4c43-91d9-f478fab0559f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:33.093177 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1afebc46-98a8-4c43-91d9-f478fab0559f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:33.094568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1afebc46-98a8-4c43-91d9-f478fab0559f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.236500 May 25 15:43:33.095396 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 296/569] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:32 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:33.108767 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-decf501e-b38c-45f5-9d71-87329fe49a9c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:33.109410 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-decf501e-b38c-45f5-9d71-87329fe49a9c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:33.116691 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-decf501e-b38c-45f5-9d71-87329fe49a9c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:33.117152 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-decf501e-b38c-45f5-9d71-87329fe49a9c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:33.117937 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-decf501e-b38c-45f5-9d71-87329fe49a9c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:33.118385 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-decf501e-b38c-45f5-9d71-87329fe49a9c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:33.266753 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b5013b27-0ad2-4478-9708-0b62a4b41742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:33.276005 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b5013b27-0ad2-4478-9708-0b62a4b41742 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.229826 May 25 15:43:33.276785 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 274/570] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:33 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:33.346498 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-decf501e-b38c-45f5-9d71-87329fe49a9c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:33.357144 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-decf501e-b38c-45f5-9d71-87329fe49a9c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.251865 May 25 15:43:33.357728 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 297/571] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:33 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:33.358338 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-decd89ec-b36d-418f-94cc-8f79439d3f51 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:33.359120 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-decd89ec-b36d-418f-94cc-8f79439d3f51 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:33.369466 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-decd89ec-b36d-418f-94cc-8f79439d3f51 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:33.369995 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-decd89ec-b36d-418f-94cc-8f79439d3f51 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:33.370861 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-decd89ec-b36d-418f-94cc-8f79439d3f51 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:33.371374 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-decd89ec-b36d-418f-94cc-8f79439d3f51 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:33.580275 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8a5be130-79c1-45ed-8cba-3ff9989de9a1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:33.581237 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8a5be130-79c1-45ed-8cba-3ff9989de9a1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:33.583337 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-decd89ec-b36d-418f-94cc-8f79439d3f51 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:33.589718 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8a5be130-79c1-45ed-8cba-3ff9989de9a1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:33.590180 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8a5be130-79c1-45ed-8cba-3ff9989de9a1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:33.590983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8a5be130-79c1-45ed-8cba-3ff9989de9a1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:33.591426 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8a5be130-79c1-45ed-8cba-3ff9989de9a1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:33.593763 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-decd89ec-b36d-418f-94cc-8f79439d3f51 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.239769 May 25 15:43:33.594678 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 275/572] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:33 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:33.805567 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8a5be130-79c1-45ed-8cba-3ff9989de9a1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:33.815122 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8a5be130-79c1-45ed-8cba-3ff9989de9a1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1751 microversion: 2.1 time: 0.240411 May 25 15:43:33.815707 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 298/573] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:33 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1751 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:34.112926 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4494ad32-3c99-4802-9006-984738d63c95 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:34.113612 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4494ad32-3c99-4802-9006-984738d63c95 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:34.120912 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4494ad32-3c99-4802-9006-984738d63c95 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:34.121366 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4494ad32-3c99-4802-9006-984738d63c95 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:34.122142 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4494ad32-3c99-4802-9006-984738d63c95 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:34.122580 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4494ad32-3c99-4802-9006-984738d63c95 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:34.293601 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-667d9274-f411-424b-91a7-64b803ec5979 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:34.294217 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-667d9274-f411-424b-91a7-64b803ec5979 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:34.301934 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-667d9274-f411-424b-91a7-64b803ec5979 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:34.302426 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-667d9274-f411-424b-91a7-64b803ec5979 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:34.303244 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-667d9274-f411-424b-91a7-64b803ec5979 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:34.303719 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-667d9274-f411-424b-91a7-64b803ec5979 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:34.329098 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4494ad32-3c99-4802-9006-984738d63c95 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:34.338902 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4494ad32-3c99-4802-9006-984738d63c95 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:34.340480 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4494ad32-3c99-4802-9006-984738d63c95 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:34.341641 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4494ad32-3c99-4802-9006-984738d63c95 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.232492 May 25 15:43:34.342201 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 276/574] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:34 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:34.374834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6e4d859a-8525-4ab2-929d-fba4b87d788c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:34.375399 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6e4d859a-8525-4ab2-929d-fba4b87d788c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:34.383427 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6e4d859a-8525-4ab2-929d-fba4b87d788c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:34.383917 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6e4d859a-8525-4ab2-929d-fba4b87d788c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:34.384713 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6e4d859a-8525-4ab2-929d-fba4b87d788c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:34.385165 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6e4d859a-8525-4ab2-929d-fba4b87d788c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:34.505958 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-667d9274-f411-424b-91a7-64b803ec5979 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:34.514533 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-667d9274-f411-424b-91a7-64b803ec5979 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.224640 May 25 15:43:34.515112 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 299/575] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:34 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:34.586331 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-6e4d859a-8525-4ab2-929d-fba4b87d788c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:34.595264 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6e4d859a-8525-4ab2-929d-fba4b87d788c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.224259 May 25 15:43:34.595840 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 277/576] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:34 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:34.610219 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-40fce301-b751-4ed6-af2f-d37f83a91a25 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:34.610845 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-40fce301-b751-4ed6-af2f-d37f83a91a25 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:34.618616 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-40fce301-b751-4ed6-af2f-d37f83a91a25 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:34.619075 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-40fce301-b751-4ed6-af2f-d37f83a91a25 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:34.619854 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-40fce301-b751-4ed6-af2f-d37f83a91a25 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:34.620329 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-40fce301-b751-4ed6-af2f-d37f83a91a25 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:34.832716 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dbd98ed3-8077-4182-9654-15f8acdf91d9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:34.833341 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-dbd98ed3-8077-4182-9654-15f8acdf91d9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:34.840885 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dbd98ed3-8077-4182-9654-15f8acdf91d9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:34.841344 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dbd98ed3-8077-4182-9654-15f8acdf91d9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:34.842124 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dbd98ed3-8077-4182-9654-15f8acdf91d9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:34.842564 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dbd98ed3-8077-4182-9654-15f8acdf91d9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:34.874956 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-40fce301-b751-4ed6-af2f-d37f83a91a25 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:34.883435 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-40fce301-b751-4ed6-af2f-d37f83a91a25 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.276856 May 25 15:43:34.884040 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 300/577] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:34 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:35.057408 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-dbd98ed3-8077-4182-9654-15f8acdf91d9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:35.067289 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dbd98ed3-8077-4182-9654-15f8acdf91d9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1751 microversion: 2.1 time: 0.238468 May 25 15:43:35.067788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 278/578] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:34 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1751 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:35.359765 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4611ae09-b980-4e71-85bc-bae297b24043 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:35.360314 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4611ae09-b980-4e71-85bc-bae297b24043 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:35.368765 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4611ae09-b980-4e71-85bc-bae297b24043 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:35.369220 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4611ae09-b980-4e71-85bc-bae297b24043 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:35.369999 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4611ae09-b980-4e71-85bc-bae297b24043 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:35.370439 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4611ae09-b980-4e71-85bc-bae297b24043 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:35.532257 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ff240585-8c2b-4d0b-862c-90ded909458a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:35.533037 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ff240585-8c2b-4d0b-862c-90ded909458a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:35.541417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ff240585-8c2b-4d0b-862c-90ded909458a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:35.542170 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ff240585-8c2b-4d0b-862c-90ded909458a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:35.543044 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ff240585-8c2b-4d0b-862c-90ded909458a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:35.543996 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ff240585-8c2b-4d0b-862c-90ded909458a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:35.567106 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4611ae09-b980-4e71-85bc-bae297b24043 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:35.577042 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4611ae09-b980-4e71-85bc-bae297b24043 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:35.578783 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4611ae09-b980-4e71-85bc-bae297b24043 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:35.580101 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4611ae09-b980-4e71-85bc-bae297b24043 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.224187 May 25 15:43:35.580738 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 301/579] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:35 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:35.613396 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-53b6a6a9-41bb-47b6-85d8-bd45d9312a61 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:35.614128 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-53b6a6a9-41bb-47b6-85d8-bd45d9312a61 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:35.626175 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-53b6a6a9-41bb-47b6-85d8-bd45d9312a61 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:35.626725 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-53b6a6a9-41bb-47b6-85d8-bd45d9312a61 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:35.628109 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-53b6a6a9-41bb-47b6-85d8-bd45d9312a61 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:35.628929 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-53b6a6a9-41bb-47b6-85d8-bd45d9312a61 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:35.832679 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-53b6a6a9-41bb-47b6-85d8-bd45d9312a61 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:35.841975 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-53b6a6a9-41bb-47b6-85d8-bd45d9312a61 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.233714 May 25 15:43:35.842565 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 302/580] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:35 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:35.900796 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-099c2507-7a2a-4727-a698-e41b11fca7ce tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:35.901317 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-099c2507-7a2a-4727-a698-e41b11fca7ce tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:35.908482 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-099c2507-7a2a-4727-a698-e41b11fca7ce tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:35.908938 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-099c2507-7a2a-4727-a698-e41b11fca7ce tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:35.910335 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-099c2507-7a2a-4727-a698-e41b11fca7ce tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:35.910773 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-099c2507-7a2a-4727-a698-e41b11fca7ce tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:36.005847 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ff240585-8c2b-4d0b-862c-90ded909458a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:36.014421 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ff240585-8c2b-4d0b-862c-90ded909458a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.485853 May 25 15:43:36.024403 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 279/581] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:35 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:36.084375 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c1f07292-4672-4e0a-a78a-40462b438d1a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:36.085182 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c1f07292-4672-4e0a-a78a-40462b438d1a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:36.092562 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c1f07292-4672-4e0a-a78a-40462b438d1a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:36.093088 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c1f07292-4672-4e0a-a78a-40462b438d1a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:36.093934 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c1f07292-4672-4e0a-a78a-40462b438d1a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:36.094443 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c1f07292-4672-4e0a-a78a-40462b438d1a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:36.107012 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-099c2507-7a2a-4727-a698-e41b11fca7ce tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:36.115754 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-099c2507-7a2a-4727-a698-e41b11fca7ce tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.218894 May 25 15:43:36.116657 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 303/582] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:35 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:36.295223 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c1f07292-4672-4e0a-a78a-40462b438d1a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:36.304729 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c1f07292-4672-4e0a-a78a-40462b438d1a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1751 microversion: 2.1 time: 0.224462 May 25 15:43:36.305233 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 280/583] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:36 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1751 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:36.598740 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b2460ddf-aac0-49d3-8215-c2067cd85f67 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:36.599286 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b2460ddf-aac0-49d3-8215-c2067cd85f67 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:36.606692 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b2460ddf-aac0-49d3-8215-c2067cd85f67 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:36.607151 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b2460ddf-aac0-49d3-8215-c2067cd85f67 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:36.607946 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b2460ddf-aac0-49d3-8215-c2067cd85f67 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:36.608390 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b2460ddf-aac0-49d3-8215-c2067cd85f67 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:36.804108 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b2460ddf-aac0-49d3-8215-c2067cd85f67 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:36.814440 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b2460ddf-aac0-49d3-8215-c2067cd85f67 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:36.816177 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b2460ddf-aac0-49d3-8215-c2067cd85f67 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:36.817375 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b2460ddf-aac0-49d3-8215-c2067cd85f67 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.223000 May 25 15:43:36.817940 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 304/584] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:36 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:36.858362 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-72d4b29d-dfc9-4706-9321-74f510c22a8e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:36.859098 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-72d4b29d-dfc9-4706-9321-74f510c22a8e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:36.866621 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-72d4b29d-dfc9-4706-9321-74f510c22a8e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:36.867165 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-72d4b29d-dfc9-4706-9321-74f510c22a8e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:36.868112 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-72d4b29d-dfc9-4706-9321-74f510c22a8e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:36.868634 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-72d4b29d-dfc9-4706-9321-74f510c22a8e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:37.033000 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0bf81356-c8f5-4ed5-bdee-193114a0c038 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:37.033898 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0bf81356-c8f5-4ed5-bdee-193114a0c038 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:37.041962 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0bf81356-c8f5-4ed5-bdee-193114a0c038 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:37.042415 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0bf81356-c8f5-4ed5-bdee-193114a0c038 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:37.043188 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0bf81356-c8f5-4ed5-bdee-193114a0c038 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:37.043708 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0bf81356-c8f5-4ed5-bdee-193114a0c038 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:37.075481 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-72d4b29d-dfc9-4706-9321-74f510c22a8e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:37.084866 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-72d4b29d-dfc9-4706-9321-74f510c22a8e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.230265 May 25 15:43:37.085439 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 281/585] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:36 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:37.132652 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-910c728c-c9a2-4431-8e71-96faf5cae576 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:37.133413 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-910c728c-c9a2-4431-8e71-96faf5cae576 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:37.141238 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-910c728c-c9a2-4431-8e71-96faf5cae576 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:37.141776 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-910c728c-c9a2-4431-8e71-96faf5cae576 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:37.142640 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-910c728c-c9a2-4431-8e71-96faf5cae576 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:37.143170 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-910c728c-c9a2-4431-8e71-96faf5cae576 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:37.245546 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-0bf81356-c8f5-4ed5-bdee-193114a0c038 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:37.254425 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0bf81356-c8f5-4ed5-bdee-193114a0c038 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.225903 May 25 15:43:37.255464 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 305/586] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:37 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:37.321907 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-72348fa3-f80f-46f0-af3f-d67e64ed0478 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:37.323146 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-72348fa3-f80f-46f0-af3f-d67e64ed0478 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:37.330519 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-72348fa3-f80f-46f0-af3f-d67e64ed0478 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:37.331052 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-72348fa3-f80f-46f0-af3f-d67e64ed0478 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:37.332521 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-72348fa3-f80f-46f0-af3f-d67e64ed0478 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:37.333482 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-72348fa3-f80f-46f0-af3f-d67e64ed0478 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:37.346371 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-910c728c-c9a2-4431-8e71-96faf5cae576 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:37.355786 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-910c728c-c9a2-4431-8e71-96faf5cae576 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.226795 May 25 15:43:37.356403 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 282/587] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:37 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:37.551980 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-72348fa3-f80f-46f0-af3f-d67e64ed0478 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:37.560625 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-72348fa3-f80f-46f0-af3f-d67e64ed0478 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.242485 May 25 15:43:37.561410 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 306/588] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:37 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:37.835393 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1847ce96-53da-4c8c-a062-dbd930ee3681 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:37.836215 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1847ce96-53da-4c8c-a062-dbd930ee3681 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:37.844424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1847ce96-53da-4c8c-a062-dbd930ee3681 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:37.844885 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1847ce96-53da-4c8c-a062-dbd930ee3681 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:37.845672 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1847ce96-53da-4c8c-a062-dbd930ee3681 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:37.846147 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1847ce96-53da-4c8c-a062-dbd930ee3681 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:38.101532 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e195dc1b-f57b-467e-bdc6-b82a26ea8e67 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:38.102161 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e195dc1b-f57b-467e-bdc6-b82a26ea8e67 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:38.109464 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e195dc1b-f57b-467e-bdc6-b82a26ea8e67 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:38.109931 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e195dc1b-f57b-467e-bdc6-b82a26ea8e67 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:38.110722 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e195dc1b-f57b-467e-bdc6-b82a26ea8e67 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:38.111177 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e195dc1b-f57b-467e-bdc6-b82a26ea8e67 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:38.221181 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1847ce96-53da-4c8c-a062-dbd930ee3681 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:38.230748 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1847ce96-53da-4c8c-a062-dbd930ee3681 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:38.232238 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1847ce96-53da-4c8c-a062-dbd930ee3681 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:38.233454 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1847ce96-53da-4c8c-a062-dbd930ee3681 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.401761 May 25 15:43:38.243356 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 283/589] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:37 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:38.272214 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fafd2db8-8e63-4d00-ab2d-ae467284e6e7 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:38.272841 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fafd2db8-8e63-4d00-ab2d-ae467284e6e7 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:38.280462 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fafd2db8-8e63-4d00-ab2d-ae467284e6e7 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:38.280935 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fafd2db8-8e63-4d00-ab2d-ae467284e6e7 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:38.281727 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fafd2db8-8e63-4d00-ab2d-ae467284e6e7 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:38.282175 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fafd2db8-8e63-4d00-ab2d-ae467284e6e7 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:38.313064 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-e195dc1b-f57b-467e-bdc6-b82a26ea8e67 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:38.323901 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e195dc1b-f57b-467e-bdc6-b82a26ea8e67 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1568 microversion: 2.1 time: 0.225963 May 25 15:43:38.324721 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 307/590] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:38 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:38.372313 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2109e62d-6503-4e94-bc1f-62174216f08b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:38.372989 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2109e62d-6503-4e94-bc1f-62174216f08b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:38.381382 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2109e62d-6503-4e94-bc1f-62174216f08b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:38.381879 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2109e62d-6503-4e94-bc1f-62174216f08b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:38.382681 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2109e62d-6503-4e94-bc1f-62174216f08b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:38.383123 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2109e62d-6503-4e94-bc1f-62174216f08b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:38.584367 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2109e62d-6503-4e94-bc1f-62174216f08b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:38.593455 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2109e62d-6503-4e94-bc1f-62174216f08b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.224900 May 25 15:43:38.601130 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 308/591] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:38 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:38.601130 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4a8d4261-6a3a-4362-ab01-01134deac2bd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:38.601130 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4a8d4261-6a3a-4362-ab01-01134deac2bd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:38.606732 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4a8d4261-6a3a-4362-ab01-01134deac2bd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:38.607192 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4a8d4261-6a3a-4362-ab01-01134deac2bd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:38.607999 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4a8d4261-6a3a-4362-ab01-01134deac2bd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:38.608447 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4a8d4261-6a3a-4362-ab01-01134deac2bd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:38.623934 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-fafd2db8-8e63-4d00-ab2d-ae467284e6e7 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:38.634581 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fafd2db8-8e63-4d00-ab2d-ae467284e6e7 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1504 microversion: 2.1 time: 0.365936 May 25 15:43:38.635264 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 284/592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:38 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:38.774103 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-a998f4ab-ed19-4237-9109-60fa925c2c41 req-8df33b2c-629d-4c4a-974f-ff2c533db8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e4fd0b-1392-4753-92e7-bab6790baa22", "name": "network-vif-deleted", "tag": "b85f42e2-6150-40d8-a0ac-30b059e7807b"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:38.777047 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:43:38.777047 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:43:38.785155 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-a998f4ab-ed19-4237-9109-60fa925c2c41 req-8df33b2c-629d-4c4a-974f-ff2c533db8fa service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:38.785963 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-a998f4ab-ed19-4237-9109-60fa925c2c41 req-8df33b2c-629d-4c4a-974f-ff2c533db8fa service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:38.804336 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-a998f4ab-ed19-4237-9109-60fa925c2c41 req-8df33b2c-629d-4c4a-974f-ff2c533db8fa service nova] Creating event network-vif-deleted:b85f42e2-6150-40d8-a0ac-30b059e7807b for instance 79e4fd0b-1392-4753-92e7-bab6790baa22 on hv-cinder-79123 May 25 15:43:38.817304 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-a998f4ab-ed19-4237-9109-60fa925c2c41 req-8df33b2c-629d-4c4a-974f-ff2c533db8fa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046716 May 25 15:43:38.818242 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 285/593] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:43:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:43:38.895400 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4a8d4261-6a3a-4362-ab01-01134deac2bd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:38.905728 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4a8d4261-6a3a-4362-ab01-01134deac2bd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.310416 May 25 15:43:38.916611 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 309/594] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:38 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:38.968549 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-8955e202-8940-49c2-82cd-331339d3085c req-7c706ef8-5b04-439b-ac01-7470938b1d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd52975-28c3-4fb7-ada2-905a8a9c571f", "name": "network-vif-plugged", "status": "completed", "tag": "746ae7a8-06cf-478c-b6d4-ecf4e9c02988"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:38.969978 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:43:38.969978 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:43:38.979200 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-8955e202-8940-49c2-82cd-331339d3085c req-7c706ef8-5b04-439b-ac01-7470938b1d24 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:38.979718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-8955e202-8940-49c2-82cd-331339d3085c req-7c706ef8-5b04-439b-ac01-7470938b1d24 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:38.996176 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-8955e202-8940-49c2-82cd-331339d3085c req-7c706ef8-5b04-439b-ac01-7470938b1d24 service nova] Creating event network-vif-plugged:746ae7a8-06cf-478c-b6d4-ecf4e9c02988 for instance 4cd52975-28c3-4fb7-ada2-905a8a9c571f on hv-cinder-79123 May 25 15:43:39.000734 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-8955e202-8940-49c2-82cd-331339d3085c req-7c706ef8-5b04-439b-ac01-7470938b1d24 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036635 May 25 15:43:39.001409 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 286/595] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:43:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:43:39.251877 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-975236ed-482d-4684-b1e8-07537d67e03f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:39.252507 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-975236ed-482d-4684-b1e8-07537d67e03f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:39.260259 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-975236ed-482d-4684-b1e8-07537d67e03f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.260722 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-975236ed-482d-4684-b1e8-07537d67e03f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.261764 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-975236ed-482d-4684-b1e8-07537d67e03f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.262204 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-975236ed-482d-4684-b1e8-07537d67e03f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.341508 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-20f593ad-d816-4aeb-86d5-b59f5e66d42b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:39.342264 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-20f593ad-d816-4aeb-86d5-b59f5e66d42b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:39.350874 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-20f593ad-d816-4aeb-86d5-b59f5e66d42b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.351335 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-20f593ad-d816-4aeb-86d5-b59f5e66d42b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.352144 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-20f593ad-d816-4aeb-86d5-b59f5e66d42b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.352588 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-20f593ad-d816-4aeb-86d5-b59f5e66d42b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.474397 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-975236ed-482d-4684-b1e8-07537d67e03f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:39.485291 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-975236ed-482d-4684-b1e8-07537d67e03f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:39.486866 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-975236ed-482d-4684-b1e8-07537d67e03f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:39.488789 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-975236ed-482d-4684-b1e8-07537d67e03f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.240622 May 25 15:43:39.492550 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 310/596] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:39 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:39.610027 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5d430c61-3d3b-49b3-a54a-ae5eb4dc9bf2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:39.610844 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5d430c61-3d3b-49b3-a54a-ae5eb4dc9bf2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:39.619010 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5d430c61-3d3b-49b3-a54a-ae5eb4dc9bf2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.619469 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5d430c61-3d3b-49b3-a54a-ae5eb4dc9bf2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.620277 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5d430c61-3d3b-49b3-a54a-ae5eb4dc9bf2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.620722 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5d430c61-3d3b-49b3-a54a-ae5eb4dc9bf2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.663932 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-20f593ad-d816-4aeb-86d5-b59f5e66d42b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:39.681226 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-20f593ad-d816-4aeb-86d5-b59f5e66d42b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1548 microversion: 2.1 time: 0.343200 May 25 15:43:39.681955 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 287/597] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:39 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1548 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:39.691465 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f31f6ad2-03cd-4017-b91e-a717b63072ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:39.694129 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f31f6ad2-03cd-4017-b91e-a717b63072ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:39.701922 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f31f6ad2-03cd-4017-b91e-a717b63072ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.702388 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f31f6ad2-03cd-4017-b91e-a717b63072ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.703207 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f31f6ad2-03cd-4017-b91e-a717b63072ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.703651 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f31f6ad2-03cd-4017-b91e-a717b63072ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.785794 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f31f6ad2-03cd-4017-b91e-a717b63072ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.786246 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f31f6ad2-03cd-4017-b91e-a717b63072ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.786703 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.objects.instance [None req-f31f6ad2-03cd-4017-b91e-a717b63072ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lazy-loading 'fault' on Instance uuid 79e4fd0b-1392-4753-92e7-bab6790baa22 {{(pid=112577) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:43:39.863606 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f31f6ad2-03cd-4017-b91e-a717b63072ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23958e7697bd4a84b8ec0a7992437036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:39.871206 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f31f6ad2-03cd-4017-b91e-a717b63072ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 200 len: 1304 microversion: 2.1 time: 0.184139 May 25 15:43:39.871783 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 288/598] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:39 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:39.876259 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-734f29e6-f33b-4b8a-a4e0-2cabdd9bf5dd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:39.876762 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-734f29e6-f33b-4b8a-a4e0-2cabdd9bf5dd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:39.884424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-734f29e6-f33b-4b8a-a4e0-2cabdd9bf5dd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.884881 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-734f29e6-f33b-4b8a-a4e0-2cabdd9bf5dd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.885693 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-734f29e6-f33b-4b8a-a4e0-2cabdd9bf5dd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.886396 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-734f29e6-f33b-4b8a-a4e0-2cabdd9bf5dd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.970016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5d430c61-3d3b-49b3-a54a-ae5eb4dc9bf2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:39.978317 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5d430c61-3d3b-49b3-a54a-ae5eb4dc9bf2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.372030 May 25 15:43:39.978880 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 311/599] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:39 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:39.983123 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b19cd585-5ab5-4d16-8397-d832c5c3d0d7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:39.983740 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b19cd585-5ab5-4d16-8397-d832c5c3d0d7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:39.991174 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b19cd585-5ab5-4d16-8397-d832c5c3d0d7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.991633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b19cd585-5ab5-4d16-8397-d832c5c3d0d7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.992441 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b19cd585-5ab5-4d16-8397-d832c5c3d0d7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.992884 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b19cd585-5ab5-4d16-8397-d832c5c3d0d7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:40.050637 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-734f29e6-f33b-4b8a-a4e0-2cabdd9bf5dd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] HTTP exception thrown: Cannot 'detach_volume' instance 1b62e88c-87e4-4020-9fc4-9b2cffdc55de while it is in vm_state rescued May 25 15:43:40.051243 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-734f29e6-f33b-4b8a-a4e0-2cabdd9bf5dd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Returning 409 to user: Cannot 'detach_volume' instance 1b62e88c-87e4-4020-9fc4-9b2cffdc55de while it is in vm_state rescued {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:43:40.052106 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-734f29e6-f33b-4b8a-a4e0-2cabdd9bf5dd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/os-volume_attachments/6b806c39-6512-4e14-aea2-284e47265542" status: 409 len: 152 microversion: 2.1 time: 0.179343 May 25 15:43:40.052662 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 289/600] 10.222.0.36 () {58 vars in 1416 bytes} [Tue May 25 15:43:39 2021] DELETE /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/os-volume_attachments/6b806c39-6512-4e14-aea2-284e47265542 => generated 152 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 15:43:40.060620 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8933df4a-a9bc-4326-8a41-b5bfc422b104 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:40.061158 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8933df4a-a9bc-4326-8a41-b5bfc422b104 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:40.069073 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8933df4a-a9bc-4326-8a41-b5bfc422b104 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:40.069522 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8933df4a-a9bc-4326-8a41-b5bfc422b104 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:40.070292 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8933df4a-a9bc-4326-8a41-b5bfc422b104 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:40.070736 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8933df4a-a9bc-4326-8a41-b5bfc422b104 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:40.194392 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b19cd585-5ab5-4d16-8397-d832c5c3d0d7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:40.203445 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8933df4a-a9bc-4326-8a41-b5bfc422b104 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "POST /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/action" status: 202 len: 0 microversion: 2.1 time: 0.146077 May 25 15:43:40.203953 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b19cd585-5ab5-4d16-8397-d832c5c3d0d7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.224055 May 25 15:43:40.207661 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 290/601] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:43:40 2021] POST /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:43:40.207803 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 312/602] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:39 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:40.212933 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dc9ab252-8f81-4645-b6ea-daa9f0433930 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:40.213639 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-dc9ab252-8f81-4645-b6ea-daa9f0433930 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:40.223182 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dc9ab252-8f81-4645-b6ea-daa9f0433930 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:40.223642 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dc9ab252-8f81-4645-b6ea-daa9f0433930 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:40.224516 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dc9ab252-8f81-4645-b6ea-daa9f0433930 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:40.225003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dc9ab252-8f81-4645-b6ea-daa9f0433930 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:40.507138 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c8355e16-8f5d-4073-8708-9f3e1cd93715 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:40.507768 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c8355e16-8f5d-4073-8708-9f3e1cd93715 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:40.515255 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c8355e16-8f5d-4073-8708-9f3e1cd93715 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:40.515714 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c8355e16-8f5d-4073-8708-9f3e1cd93715 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:40.516548 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c8355e16-8f5d-4073-8708-9f3e1cd93715 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:40.516991 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c8355e16-8f5d-4073-8708-9f3e1cd93715 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:40.541707 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-dc9ab252-8f81-4645-b6ea-daa9f0433930 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:40.551401 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dc9ab252-8f81-4645-b6ea-daa9f0433930 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1556 microversion: 2.1 time: 0.341992 May 25 15:43:40.553398 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 291/603] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:40 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1556 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:40.717164 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c8355e16-8f5d-4073-8708-9f3e1cd93715 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:40.727135 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c8355e16-8f5d-4073-8708-9f3e1cd93715 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:40.728700 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c8355e16-8f5d-4073-8708-9f3e1cd93715 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:40.730314 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c8355e16-8f5d-4073-8708-9f3e1cd93715 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.226729 May 25 15:43:40.730872 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 313/604] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:40 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:43:40.889105 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-403b5f22-e408-47db-87fd-e37f5e76041a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:40.889723 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-403b5f22-e408-47db-87fd-e37f5e76041a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] [instance: 79e4fd0b-1392-4753-92e7-bab6790baa22] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:40.898063 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-403b5f22-e408-47db-87fd-e37f5e76041a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:40.898518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-403b5f22-e408-47db-87fd-e37f5e76041a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:40.899327 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-403b5f22-e408-47db-87fd-e37f5e76041a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:40.899765 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-403b5f22-e408-47db-87fd-e37f5e76041a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:40.949039 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-403b5f22-e408-47db-87fd-e37f5e76041a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] HTTP exception thrown: Instance 79e4fd0b-1392-4753-92e7-bab6790baa22 could not be found. May 25 15:43:40.949648 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-403b5f22-e408-47db-87fd-e37f5e76041a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Returning 404 to user: Instance 79e4fd0b-1392-4753-92e7-bab6790baa22 could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:43:40.950495 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-403b5f22-e408-47db-87fd-e37f5e76041a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22" status: 404 len: 111 microversion: 2.1 time: 0.065390 May 25 15:43:40.951051 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 292/605] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:40 2021] GET /compute/v2.1/servers/79e4fd0b-1392-4753-92e7-bab6790baa22 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:43:40.994393 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e776972b-4018-4ff2-b2e5-9000b0f4d633 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:40.995159 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e776972b-4018-4ff2-b2e5-9000b0f4d633 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:41.002865 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e776972b-4018-4ff2-b2e5-9000b0f4d633 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:41.003957 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e776972b-4018-4ff2-b2e5-9000b0f4d633 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:41.004849 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e776972b-4018-4ff2-b2e5-9000b0f4d633 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:41.005502 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e776972b-4018-4ff2-b2e5-9000b0f4d633 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:41.223590 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6688e970-4420-4ece-8e70-837eda33b32a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:41.224469 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6688e970-4420-4ece-8e70-837eda33b32a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:41.232734 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6688e970-4420-4ece-8e70-837eda33b32a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:41.233383 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6688e970-4420-4ece-8e70-837eda33b32a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:41.234190 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6688e970-4420-4ece-8e70-837eda33b32a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:41.234641 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6688e970-4420-4ece-8e70-837eda33b32a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:41.237245 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-e776972b-4018-4ff2-b2e5-9000b0f4d633 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:41.246752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e776972b-4018-4ff2-b2e5-9000b0f4d633 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1266 microversion: 2.1 time: 0.255912 May 25 15:43:41.247568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 314/606] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:40 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:41.440642 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-6688e970-4420-4ece-8e70-837eda33b32a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:41.449901 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6688e970-4420-4ece-8e70-837eda33b32a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.232863 May 25 15:43:41.450549 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 293/607] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:41 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:41.568855 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-513065ec-3ba6-4291-8aba-de29ee14e575 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:41.569485 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-513065ec-3ba6-4291-8aba-de29ee14e575 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:41.576749 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-513065ec-3ba6-4291-8aba-de29ee14e575 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:41.577215 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-513065ec-3ba6-4291-8aba-de29ee14e575 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:41.578012 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-513065ec-3ba6-4291-8aba-de29ee14e575 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:41.578460 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-513065ec-3ba6-4291-8aba-de29ee14e575 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:41.749720 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-162e1ef6-78ed-43fd-87de-ffbb67687bbb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:41.751125 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-162e1ef6-78ed-43fd-87de-ffbb67687bbb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:41.760780 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-162e1ef6-78ed-43fd-87de-ffbb67687bbb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:41.762077 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-162e1ef6-78ed-43fd-87de-ffbb67687bbb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:41.763564 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-162e1ef6-78ed-43fd-87de-ffbb67687bbb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:41.764277 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-162e1ef6-78ed-43fd-87de-ffbb67687bbb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:41.793626 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-513065ec-3ba6-4291-8aba-de29ee14e575 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:41.804086 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-513065ec-3ba6-4291-8aba-de29ee14e575 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1556 microversion: 2.1 time: 0.237832 May 25 15:43:41.804861 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 315/608] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:41 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:41.985005 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-162e1ef6-78ed-43fd-87de-ffbb67687bbb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:41.994826 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-162e1ef6-78ed-43fd-87de-ffbb67687bbb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:41.996504 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-162e1ef6-78ed-43fd-87de-ffbb67687bbb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:41.997657 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-162e1ef6-78ed-43fd-87de-ffbb67687bbb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.252282 May 25 15:43:41.998247 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 294/609] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:41 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:43:42.263944 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0aa31af3-74eb-47f3-af57-fba9166918c6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:42.264687 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0aa31af3-74eb-47f3-af57-fba9166918c6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:42.273940 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0aa31af3-74eb-47f3-af57-fba9166918c6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:42.274396 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0aa31af3-74eb-47f3-af57-fba9166918c6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:42.275175 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0aa31af3-74eb-47f3-af57-fba9166918c6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:42.275616 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0aa31af3-74eb-47f3-af57-fba9166918c6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:42.467450 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d51296ee-f03f-4680-9500-f4a155eeacc5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:42.468104 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d51296ee-f03f-4680-9500-f4a155eeacc5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:42.468210 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-0aa31af3-74eb-47f3-af57-fba9166918c6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:42.476134 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d51296ee-f03f-4680-9500-f4a155eeacc5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:42.476591 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d51296ee-f03f-4680-9500-f4a155eeacc5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:42.477084 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0aa31af3-74eb-47f3-af57-fba9166918c6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1452 microversion: 2.1 time: 0.217000 May 25 15:43:42.477374 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d51296ee-f03f-4680-9500-f4a155eeacc5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:42.477659 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 316/610] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:42 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1452 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:42.477877 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d51296ee-f03f-4680-9500-f4a155eeacc5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:42.493190 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-cdc2e3f6-314b-424d-85a3-888a67115f87 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:42.493770 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-cdc2e3f6-314b-424d-85a3-888a67115f87 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:42.501025 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cdc2e3f6-314b-424d-85a3-888a67115f87 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:42.501477 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cdc2e3f6-314b-424d-85a3-888a67115f87 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:42.502264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cdc2e3f6-314b-424d-85a3-888a67115f87 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:42.502711 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cdc2e3f6-314b-424d-85a3-888a67115f87 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:42.684141 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d51296ee-f03f-4680-9500-f4a155eeacc5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:42.693386 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d51296ee-f03f-4680-9500-f4a155eeacc5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.229708 May 25 15:43:42.694060 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 295/611] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:42 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:42.705922 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-cdc2e3f6-314b-424d-85a3-888a67115f87 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:42.714727 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-cdc2e3f6-314b-424d-85a3-888a67115f87 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1452 microversion: 2.1 time: 0.225156 May 25 15:43:42.715288 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 317/612] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:42 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1452 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:42.821726 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-bb572bcf-0c6e-4e7a-a6a4-0ba8bec6d0ed tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:42.822437 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-bb572bcf-0c6e-4e7a-a6a4-0ba8bec6d0ed tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:42.829847 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bb572bcf-0c6e-4e7a-a6a4-0ba8bec6d0ed tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:42.830309 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bb572bcf-0c6e-4e7a-a6a4-0ba8bec6d0ed tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:42.831594 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bb572bcf-0c6e-4e7a-a6a4-0ba8bec6d0ed tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:42.832070 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bb572bcf-0c6e-4e7a-a6a4-0ba8bec6d0ed tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:43.016547 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8dcd23d0-f615-453d-bf89-546c2b11c381 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:43.017084 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8dcd23d0-f615-453d-bf89-546c2b11c381 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:43.025014 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8dcd23d0-f615-453d-bf89-546c2b11c381 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:43.025479 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8dcd23d0-f615-453d-bf89-546c2b11c381 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:43.026292 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8dcd23d0-f615-453d-bf89-546c2b11c381 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:43.026731 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8dcd23d0-f615-453d-bf89-546c2b11c381 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:43.035814 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-bb572bcf-0c6e-4e7a-a6a4-0ba8bec6d0ed tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:43.044470 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-bb572bcf-0c6e-4e7a-a6a4-0ba8bec6d0ed tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1556 microversion: 2.1 time: 0.226502 May 25 15:43:43.051738 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 296/613] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:42 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1556 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:43.361034 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8dcd23d0-f615-453d-bf89-546c2b11c381 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:43.370511 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8dcd23d0-f615-453d-bf89-546c2b11c381 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:43.372065 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8dcd23d0-f615-453d-bf89-546c2b11c381 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:43.373222 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8dcd23d0-f615-453d-bf89-546c2b11c381 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.360454 May 25 15:43:43.373969 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 318/614] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:43 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:43:43.711288 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-210cdc79-0150-4dde-8ebe-cfdcf8e40bf5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:43.712211 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-210cdc79-0150-4dde-8ebe-cfdcf8e40bf5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:43.719352 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-210cdc79-0150-4dde-8ebe-cfdcf8e40bf5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:43.719801 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-210cdc79-0150-4dde-8ebe-cfdcf8e40bf5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:43.720605 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-210cdc79-0150-4dde-8ebe-cfdcf8e40bf5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:43.721046 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-210cdc79-0150-4dde-8ebe-cfdcf8e40bf5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:43.922189 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-210cdc79-0150-4dde-8ebe-cfdcf8e40bf5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:43.931812 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-210cdc79-0150-4dde-8ebe-cfdcf8e40bf5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.224179 May 25 15:43:43.932417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 297/615] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:43 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:44.060753 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7b441e8a-a6ad-4dc9-9554-ca23eb80208e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:44.061378 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7b441e8a-a6ad-4dc9-9554-ca23eb80208e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:44.068948 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7b441e8a-a6ad-4dc9-9554-ca23eb80208e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:44.069658 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7b441e8a-a6ad-4dc9-9554-ca23eb80208e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:44.070440 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7b441e8a-a6ad-4dc9-9554-ca23eb80208e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:44.070884 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7b441e8a-a6ad-4dc9-9554-ca23eb80208e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:44.391965 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f4e79820-44b0-49c8-92b8-e69d58146155 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:44.392507 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f4e79820-44b0-49c8-92b8-e69d58146155 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:44.400357 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f4e79820-44b0-49c8-92b8-e69d58146155 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:44.400814 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f4e79820-44b0-49c8-92b8-e69d58146155 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:44.401600 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f4e79820-44b0-49c8-92b8-e69d58146155 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:44.402037 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f4e79820-44b0-49c8-92b8-e69d58146155 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:44.418723 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7b441e8a-a6ad-4dc9-9554-ca23eb80208e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:44.427484 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7b441e8a-a6ad-4dc9-9554-ca23eb80208e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1556 microversion: 2.1 time: 0.370443 May 25 15:43:44.428068 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 319/616] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:44 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1556 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:44.607102 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f4e79820-44b0-49c8-92b8-e69d58146155 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:44.617129 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f4e79820-44b0-49c8-92b8-e69d58146155 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:44.618666 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f4e79820-44b0-49c8-92b8-e69d58146155 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:44.619841 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f4e79820-44b0-49c8-92b8-e69d58146155 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.231833 May 25 15:43:44.620436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 298/617] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:44 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:43:44.949549 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a9c07afe-e518-4e7c-a1e5-7662c661babf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:44.950183 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a9c07afe-e518-4e7c-a1e5-7662c661babf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:44.958127 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a9c07afe-e518-4e7c-a1e5-7662c661babf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:44.958592 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a9c07afe-e518-4e7c-a1e5-7662c661babf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:44.959396 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a9c07afe-e518-4e7c-a1e5-7662c661babf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:44.959834 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a9c07afe-e518-4e7c-a1e5-7662c661babf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:45.344974 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a9c07afe-e518-4e7c-a1e5-7662c661babf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:45.354363 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a9c07afe-e518-4e7c-a1e5-7662c661babf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.408661 May 25 15:43:45.354935 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 320/618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:44 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:45.443373 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-bab7fb31-1b9c-4c8c-b384-0bc06ba014b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:45.444033 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-bab7fb31-1b9c-4c8c-b384-0bc06ba014b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:45.452490 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bab7fb31-1b9c-4c8c-b384-0bc06ba014b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:45.452960 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bab7fb31-1b9c-4c8c-b384-0bc06ba014b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:45.453765 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bab7fb31-1b9c-4c8c-b384-0bc06ba014b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:45.454249 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bab7fb31-1b9c-4c8c-b384-0bc06ba014b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:45.542184 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-cd0f0a93-62a2-4959-ad40-18fc25458c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd52975-28c3-4fb7-ada2-905a8a9c571f", "tag": "746ae7a8-06cf-478c-b6d4-ecf4e9c02988"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:45.544311 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:43:45.544311 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:43:45.555137 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-cd0f0a93-62a2-4959-ad40-18fc25458c7b service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:45.556165 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-cd0f0a93-62a2-4959-ad40-18fc25458c7b service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:45.575330 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-cd0f0a93-62a2-4959-ad40-18fc25458c7b service nova] Creating event network-changed:746ae7a8-06cf-478c-b6d4-ecf4e9c02988 for instance 4cd52975-28c3-4fb7-ada2-905a8a9c571f on hv-cinder-79123 May 25 15:43:45.581071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-cd0f0a93-62a2-4959-ad40-18fc25458c7b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047683 May 25 15:43:45.581940 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 321/619] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:43:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:43:45.639345 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-88af54b6-6bfb-4b29-b4dd-96df72f22606 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:45.640576 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-88af54b6-6bfb-4b29-b4dd-96df72f22606 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:45.649347 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-88af54b6-6bfb-4b29-b4dd-96df72f22606 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:45.650457 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-88af54b6-6bfb-4b29-b4dd-96df72f22606 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:45.651381 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-88af54b6-6bfb-4b29-b4dd-96df72f22606 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:45.652133 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-88af54b6-6bfb-4b29-b4dd-96df72f22606 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:45.658288 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-bab7fb31-1b9c-4c8c-b384-0bc06ba014b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:45.668395 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-bab7fb31-1b9c-4c8c-b384-0bc06ba014b4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1556 microversion: 2.1 time: 0.228639 May 25 15:43:45.669107 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 299/620] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:45 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1556 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:45.852566 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-88af54b6-6bfb-4b29-b4dd-96df72f22606 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:45.862465 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-88af54b6-6bfb-4b29-b4dd-96df72f22606 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:45.864222 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-88af54b6-6bfb-4b29-b4dd-96df72f22606 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:45.865562 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-88af54b6-6bfb-4b29-b4dd-96df72f22606 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.230703 May 25 15:43:45.866123 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 322/621] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:45 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:43:46.373051 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-db07aa59-2a77-48ab-9568-fb3f098eb3b1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:46.373387 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-db07aa59-2a77-48ab-9568-fb3f098eb3b1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:46.382054 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-db07aa59-2a77-48ab-9568-fb3f098eb3b1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:46.382513 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-db07aa59-2a77-48ab-9568-fb3f098eb3b1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:46.383480 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-db07aa59-2a77-48ab-9568-fb3f098eb3b1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:46.384001 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-db07aa59-2a77-48ab-9568-fb3f098eb3b1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:46.659001 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-db07aa59-2a77-48ab-9568-fb3f098eb3b1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:46.667800 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-db07aa59-2a77-48ab-9568-fb3f098eb3b1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.299182 May 25 15:43:46.668407 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 300/622] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:46 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:46.685541 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9de912c3-d3fc-4d28-b59b-ccf2b64145af tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:46.686291 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9de912c3-d3fc-4d28-b59b-ccf2b64145af tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:46.694582 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9de912c3-d3fc-4d28-b59b-ccf2b64145af tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:46.695120 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9de912c3-d3fc-4d28-b59b-ccf2b64145af tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:46.696155 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9de912c3-d3fc-4d28-b59b-ccf2b64145af tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:46.696674 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9de912c3-d3fc-4d28-b59b-ccf2b64145af tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:46.883213 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:46.884112 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:46.891994 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:46.892712 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:46.893726 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:46.894361 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:46.913374 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9de912c3-d3fc-4d28-b59b-ccf2b64145af tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:46.922506 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9de912c3-d3fc-4d28-b59b-ccf2b64145af tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1556 microversion: 2.1 time: 0.240705 May 25 15:43:46.923610 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 323/623] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:46 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1556 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:47.207462 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:47.217007 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:47.218622 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:47.219840 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.340313 May 25 15:43:47.220625 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 301/624] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:46 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:43:47.684797 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-27072df7-72a8-441b-a41b-62c23afb2384 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:47.685427 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-27072df7-72a8-441b-a41b-62c23afb2384 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:47.692975 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-27072df7-72a8-441b-a41b-62c23afb2384 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:47.693491 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-27072df7-72a8-441b-a41b-62c23afb2384 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:47.694238 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-27072df7-72a8-441b-a41b-62c23afb2384 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:47.694685 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-27072df7-72a8-441b-a41b-62c23afb2384 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:47.903547 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-27072df7-72a8-441b-a41b-62c23afb2384 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:47.912852 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-27072df7-72a8-441b-a41b-62c23afb2384 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.231769 May 25 15:43:47.913418 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 324/625] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:47 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:47.939559 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fff64090-5b96-43ce-9da4-cc3a6a180450 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:47.940324 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fff64090-5b96-43ce-9da4-cc3a6a180450 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:47.948018 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fff64090-5b96-43ce-9da4-cc3a6a180450 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:47.948479 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fff64090-5b96-43ce-9da4-cc3a6a180450 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:47.949300 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fff64090-5b96-43ce-9da4-cc3a6a180450 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:47.949771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fff64090-5b96-43ce-9da4-cc3a6a180450 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:48.157050 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-fff64090-5b96-43ce-9da4-cc3a6a180450 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:48.167769 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fff64090-5b96-43ce-9da4-cc3a6a180450 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1556 microversion: 2.1 time: 0.232107 May 25 15:43:48.168515 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 302/626] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:47 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1556 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:48.239617 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:48.240276 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:48.247715 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:48.248263 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:48.249228 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:48.249842 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:48.477590 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:48.487319 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:48.488892 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:48.490060 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.255454 May 25 15:43:48.490612 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 325/627] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:48 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:48.930725 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3b91560b-cc1d-4ca6-a588-0743e6f671d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:48.931610 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3b91560b-cc1d-4ca6-a588-0743e6f671d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:48.940725 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b91560b-cc1d-4ca6-a588-0743e6f671d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:48.941375 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b91560b-cc1d-4ca6-a588-0743e6f671d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:48.942302 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b91560b-cc1d-4ca6-a588-0743e6f671d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:48.942854 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b91560b-cc1d-4ca6-a588-0743e6f671d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:49.188414 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ef87952a-028f-404f-9e45-49e4b82a9f5a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:49.190256 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ef87952a-028f-404f-9e45-49e4b82a9f5a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:49.198301 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef87952a-028f-404f-9e45-49e4b82a9f5a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:49.198993 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef87952a-028f-404f-9e45-49e4b82a9f5a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:49.200246 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef87952a-028f-404f-9e45-49e4b82a9f5a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:49.201082 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef87952a-028f-404f-9e45-49e4b82a9f5a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:49.208013 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3b91560b-cc1d-4ca6-a588-0743e6f671d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:49.217334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3b91560b-cc1d-4ca6-a588-0743e6f671d0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.291135 May 25 15:43:49.232037 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 303/628] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:48 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:49.419493 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ef87952a-028f-404f-9e45-49e4b82a9f5a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:49.429523 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ef87952a-028f-404f-9e45-49e4b82a9f5a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1562 microversion: 2.1 time: 0.247193 May 25 15:43:49.430338 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 326/629] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:49 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1562 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:49.509601 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:49.510450 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:49.522066 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:49.522418 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:49.523310 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:49.523893 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:49.565071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c89d8828-41c6-4f22-9b8b-a0445b2afe77 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:49.566058 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c89d8828-41c6-4f22-9b8b-a0445b2afe77 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:49.573516 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c89d8828-41c6-4f22-9b8b-a0445b2afe77 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:49.573986 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c89d8828-41c6-4f22-9b8b-a0445b2afe77 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:49.574859 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c89d8828-41c6-4f22-9b8b-a0445b2afe77 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:49.575316 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c89d8828-41c6-4f22-9b8b-a0445b2afe77 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:49.790660 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-c89d8828-41c6-4f22-9b8b-a0445b2afe77 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lazy-loading 'services' on Instance uuid 1b62e88c-87e4-4020-9fc4-9b2cffdc55de {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:43:49.827742 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:49.838751 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:49.840951 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:49.842393 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.336488 May 25 15:43:49.845199 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 304/630] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:49 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:49.961117 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c89d8828-41c6-4f22-9b8b-a0445b2afe77 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/os-volume_attachments/6b806c39-6512-4e14-aea2-284e47265542" status: 202 len: 0 microversion: 2.1 time: 0.399641 May 25 15:43:49.962031 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 327/631] 10.222.0.36 () {58 vars in 1416 bytes} [Tue May 25 15:43:49 2021] DELETE /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de/os-volume_attachments/6b806c39-6512-4e14-aea2-284e47265542 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:43:50.240667 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-aa93d354-7e4b-479c-ae33-923a218ba720 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:50.241396 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-aa93d354-7e4b-479c-ae33-923a218ba720 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:50.249346 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-aa93d354-7e4b-479c-ae33-923a218ba720 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:50.249908 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-aa93d354-7e4b-479c-ae33-923a218ba720 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:50.250774 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-aa93d354-7e4b-479c-ae33-923a218ba720 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:50.251285 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-aa93d354-7e4b-479c-ae33-923a218ba720 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:50.469340 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-aa93d354-7e4b-479c-ae33-923a218ba720 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:50.478927 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-aa93d354-7e4b-479c-ae33-923a218ba720 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.242659 May 25 15:43:50.479507 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 305/632] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:50 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:50.865012 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:50.865796 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:50.873834 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:50.874295 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:50.875073 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:50.875518 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:51.194454 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:51.205765 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:51.207544 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:51.209018 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.348784 May 25 15:43:51.211009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 328/633] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:50 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:43:51.497282 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e68478e0-57d9-45b6-9c27-a33490669b46 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:51.497913 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e68478e0-57d9-45b6-9c27-a33490669b46 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:51.505202 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e68478e0-57d9-45b6-9c27-a33490669b46 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:51.505660 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e68478e0-57d9-45b6-9c27-a33490669b46 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:51.506437 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e68478e0-57d9-45b6-9c27-a33490669b46 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:51.506878 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e68478e0-57d9-45b6-9c27-a33490669b46 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:51.731328 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e68478e0-57d9-45b6-9c27-a33490669b46 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:51.743283 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e68478e0-57d9-45b6-9c27-a33490669b46 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.249720 May 25 15:43:51.753591 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 306/634] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:51 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:52.229358 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5776fa93-91dd-49a3-bef7-cbee38c979e0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:52.230866 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5776fa93-91dd-49a3-bef7-cbee38c979e0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:52.242529 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5776fa93-91dd-49a3-bef7-cbee38c979e0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:52.243349 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5776fa93-91dd-49a3-bef7-cbee38c979e0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:52.244404 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5776fa93-91dd-49a3-bef7-cbee38c979e0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:52.245073 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5776fa93-91dd-49a3-bef7-cbee38c979e0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:52.534000 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5776fa93-91dd-49a3-bef7-cbee38c979e0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:52.543975 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5776fa93-91dd-49a3-bef7-cbee38c979e0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:52.545612 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5776fa93-91dd-49a3-bef7-cbee38c979e0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:52.546866 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5776fa93-91dd-49a3-bef7-cbee38c979e0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.321222 May 25 15:43:52.547510 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 329/635] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:52 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:52.760543 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4d53be68-c595-49f0-b177-a6348ac03d7a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:52.761656 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4d53be68-c595-49f0-b177-a6348ac03d7a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:52.769298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4d53be68-c595-49f0-b177-a6348ac03d7a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:52.769752 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4d53be68-c595-49f0-b177-a6348ac03d7a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:52.770540 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4d53be68-c595-49f0-b177-a6348ac03d7a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:52.770989 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4d53be68-c595-49f0-b177-a6348ac03d7a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:52.953690 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-72e294b2-1599-43ac-b928-acb099ad92b3 req-8496a6d9-eef1-4355-880f-bbb6c8a3e638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9301f1db-ecb0-465b-858c-64a2bfd4d5cb", "name": "network-vif-plugged", "status": "completed", "tag": "3f734a1c-be04-4203-b351-6b0b6785f9ae"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:43:52.955362 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:43:52.955362 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:43:52.969478 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-72e294b2-1599-43ac-b928-acb099ad92b3 req-8496a6d9-eef1-4355-880f-bbb6c8a3e638 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:52.969946 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-72e294b2-1599-43ac-b928-acb099ad92b3 req-8496a6d9-eef1-4355-880f-bbb6c8a3e638 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:52.987009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-72e294b2-1599-43ac-b928-acb099ad92b3 req-8496a6d9-eef1-4355-880f-bbb6c8a3e638 service nova] Creating event network-vif-plugged:3f734a1c-be04-4203-b351-6b0b6785f9ae for instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb on hv-cinder-79123 May 25 15:43:52.992856 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-72e294b2-1599-43ac-b928-acb099ad92b3 req-8496a6d9-eef1-4355-880f-bbb6c8a3e638 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044388 May 25 15:43:52.993779 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 330/636] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:43:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:43:53.017634 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4d53be68-c595-49f0-b177-a6348ac03d7a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:53.028432 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4d53be68-c595-49f0-b177-a6348ac03d7a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.271522 May 25 15:43:53.041104 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 307/637] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:52 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:53.567647 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-38aaca1f-1717-47db-9e64-7c630c0d5dae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:53.568734 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-38aaca1f-1717-47db-9e64-7c630c0d5dae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:53.579734 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-38aaca1f-1717-47db-9e64-7c630c0d5dae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:53.580291 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-38aaca1f-1717-47db-9e64-7c630c0d5dae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:53.581778 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-38aaca1f-1717-47db-9e64-7c630c0d5dae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:53.582274 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-38aaca1f-1717-47db-9e64-7c630c0d5dae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:53.835909 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-38aaca1f-1717-47db-9e64-7c630c0d5dae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:53.845860 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-38aaca1f-1717-47db-9e64-7c630c0d5dae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:53.848035 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-38aaca1f-1717-47db-9e64-7c630c0d5dae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:53.849412 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-38aaca1f-1717-47db-9e64-7c630c0d5dae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.286647 May 25 15:43:53.853553 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 331/638] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:53 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:54.048380 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-cda2769a-a4c4-4074-bf2c-a7cc92cf2f88 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:54.049069 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-cda2769a-a4c4-4074-bf2c-a7cc92cf2f88 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:54.058849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cda2769a-a4c4-4074-bf2c-a7cc92cf2f88 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:54.059316 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cda2769a-a4c4-4074-bf2c-a7cc92cf2f88 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:54.060138 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cda2769a-a4c4-4074-bf2c-a7cc92cf2f88 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:54.060587 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cda2769a-a4c4-4074-bf2c-a7cc92cf2f88 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:54.358930 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cda2769a-a4c4-4074-bf2c-a7cc92cf2f88 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:54.370185 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-cda2769a-a4c4-4074-bf2c-a7cc92cf2f88 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.326010 May 25 15:43:54.370926 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 308/639] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:54 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:54.867640 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2ebb07e3-61e8-4bd6-835c-f9b87626043c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:54.868341 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2ebb07e3-61e8-4bd6-835c-f9b87626043c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:54.875930 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2ebb07e3-61e8-4bd6-835c-f9b87626043c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:54.876402 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2ebb07e3-61e8-4bd6-835c-f9b87626043c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:54.877212 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2ebb07e3-61e8-4bd6-835c-f9b87626043c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:54.877692 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2ebb07e3-61e8-4bd6-835c-f9b87626043c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:54.989886 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-30511015-7702-43f1-8ad4-7748e58ff726 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:54.991080 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-30511015-7702-43f1-8ad4-7748e58ff726 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:55.013688 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-30511015-7702-43f1-8ad4-7748e58ff726 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:55.014447 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-30511015-7702-43f1-8ad4-7748e58ff726 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:55.015988 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-30511015-7702-43f1-8ad4-7748e58ff726 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:55.016686 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-30511015-7702-43f1-8ad4-7748e58ff726 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:55.102677 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-30511015-7702-43f1-8ad4-7748e58ff726 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Going to try to terminate instance {{(pid=112577) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:43:55.154775 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2ebb07e3-61e8-4bd6-835c-f9b87626043c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:55.166903 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2ebb07e3-61e8-4bd6-835c-f9b87626043c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:55.168847 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2ebb07e3-61e8-4bd6-835c-f9b87626043c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:55.170098 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2ebb07e3-61e8-4bd6-835c-f9b87626043c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.306154 May 25 15:43:55.172238 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 332/640] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:54 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:55.253741 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-30511015-7702-43f1-8ad4-7748e58ff726 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "DELETE /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 204 len: 0 microversion: 2.1 time: 0.268801 May 25 15:43:55.257295 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 309/641] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:43:54 2021] DELETE /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:43:55.262983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c588714a-12ce-4ee3-b012-7268c87f524d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:55.263660 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c588714a-12ce-4ee3-b012-7268c87f524d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:55.272409 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c588714a-12ce-4ee3-b012-7268c87f524d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:55.272880 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c588714a-12ce-4ee3-b012-7268c87f524d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:55.274006 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c588714a-12ce-4ee3-b012-7268c87f524d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:55.274481 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c588714a-12ce-4ee3-b012-7268c87f524d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:55.388654 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-73e58323-7192-4222-a49a-69a62bdf1a1b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:55.389446 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-73e58323-7192-4222-a49a-69a62bdf1a1b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:55.398904 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-73e58323-7192-4222-a49a-69a62bdf1a1b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:55.399379 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-73e58323-7192-4222-a49a-69a62bdf1a1b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:55.400199 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-73e58323-7192-4222-a49a-69a62bdf1a1b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:55.400661 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-73e58323-7192-4222-a49a-69a62bdf1a1b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:55.483486 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c588714a-12ce-4ee3-b012-7268c87f524d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:55.494914 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c588714a-12ce-4ee3-b012-7268c87f524d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1509 microversion: 2.1 time: 0.235811 May 25 15:43:55.501217 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 333/642] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:55 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:55.614484 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-73e58323-7192-4222-a49a-69a62bdf1a1b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:55.623363 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-73e58323-7192-4222-a49a-69a62bdf1a1b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.239119 May 25 15:43:55.624185 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 310/643] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:55 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:56.193659 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-479b473e-1229-445e-803b-f2f1eb7bc7d3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:56.194226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-479b473e-1229-445e-803b-f2f1eb7bc7d3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:56.204290 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-479b473e-1229-445e-803b-f2f1eb7bc7d3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:56.204762 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-479b473e-1229-445e-803b-f2f1eb7bc7d3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:56.205745 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-479b473e-1229-445e-803b-f2f1eb7bc7d3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:56.206215 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-479b473e-1229-445e-803b-f2f1eb7bc7d3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:56.466017 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-479b473e-1229-445e-803b-f2f1eb7bc7d3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:56.477623 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-479b473e-1229-445e-803b-f2f1eb7bc7d3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:56.480709 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-479b473e-1229-445e-803b-f2f1eb7bc7d3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:56.481928 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-479b473e-1229-445e-803b-f2f1eb7bc7d3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1810 microversion: 2.20 time: 0.293481 May 25 15:43:56.483035 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 334/644] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:56 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1810 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:56.517723 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-afdd26e1-c4cb-40d7-89a1-59d5b1b47333 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:56.519385 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-afdd26e1-c4cb-40d7-89a1-59d5b1b47333 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:56.527355 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-afdd26e1-c4cb-40d7-89a1-59d5b1b47333 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:56.527832 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-afdd26e1-c4cb-40d7-89a1-59d5b1b47333 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:56.528691 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-afdd26e1-c4cb-40d7-89a1-59d5b1b47333 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:56.529131 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-afdd26e1-c4cb-40d7-89a1-59d5b1b47333 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:56.640886 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f6a5e54b-681e-4543-a252-24e20fed1533 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:56.641865 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f6a5e54b-681e-4543-a252-24e20fed1533 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:56.660660 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f6a5e54b-681e-4543-a252-24e20fed1533 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:56.661115 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f6a5e54b-681e-4543-a252-24e20fed1533 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:56.661912 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f6a5e54b-681e-4543-a252-24e20fed1533 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:56.662352 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f6a5e54b-681e-4543-a252-24e20fed1533 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:56.833407 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-afdd26e1-c4cb-40d7-89a1-59d5b1b47333 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:56.842854 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-afdd26e1-c4cb-40d7-89a1-59d5b1b47333 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1509 microversion: 2.1 time: 0.328910 May 25 15:43:56.843463 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 311/645] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:56 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:56.970429 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f6a5e54b-681e-4543-a252-24e20fed1533 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:56.980559 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f6a5e54b-681e-4543-a252-24e20fed1533 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.343819 May 25 15:43:56.981270 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 335/646] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:56 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:57.501928 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-80b6fedc-61b4-4453-ad92-dce353efcd64 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:57.503230 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-80b6fedc-61b4-4453-ad92-dce353efcd64 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:57.510933 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-80b6fedc-61b4-4453-ad92-dce353efcd64 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:57.512226 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-80b6fedc-61b4-4453-ad92-dce353efcd64 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:57.513256 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-80b6fedc-61b4-4453-ad92-dce353efcd64 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:57.513920 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-80b6fedc-61b4-4453-ad92-dce353efcd64 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:57.859955 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4cb92f4c-d3a6-4692-a430-07745db52a75 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:57.860551 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4cb92f4c-d3a6-4692-a430-07745db52a75 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:57.869661 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cb92f4c-d3a6-4692-a430-07745db52a75 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:57.870149 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cb92f4c-d3a6-4692-a430-07745db52a75 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:57.871033 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cb92f4c-d3a6-4692-a430-07745db52a75 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:57.871626 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cb92f4c-d3a6-4692-a430-07745db52a75 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:57.892975 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-80b6fedc-61b4-4453-ad92-dce353efcd64 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:57.903379 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-80b6fedc-61b4-4453-ad92-dce353efcd64 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:57.906599 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-80b6fedc-61b4-4453-ad92-dce353efcd64 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:57.907818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-80b6fedc-61b4-4453-ad92-dce353efcd64 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1797 microversion: 2.20 time: 0.409683 May 25 15:43:57.924284 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 312/647] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:43:57 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1797 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:43:57.997938 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-bd7d62bc-fecc-4fb3-b843-90550e139c2f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:57.998555 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-bd7d62bc-fecc-4fb3-b843-90550e139c2f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:58.006652 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bd7d62bc-fecc-4fb3-b843-90550e139c2f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:58.007109 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bd7d62bc-fecc-4fb3-b843-90550e139c2f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:58.007903 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bd7d62bc-fecc-4fb3-b843-90550e139c2f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:58.008341 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bd7d62bc-fecc-4fb3-b843-90550e139c2f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:58.107835 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4cb92f4c-d3a6-4692-a430-07745db52a75 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:58.119646 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4cb92f4c-d3a6-4692-a430-07745db52a75 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1509 microversion: 2.1 time: 0.263667 May 25 15:43:58.129434 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 336/648] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:57 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:43:58.233658 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-bd7d62bc-fecc-4fb3-b843-90550e139c2f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:58.246420 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-bd7d62bc-fecc-4fb3-b843-90550e139c2f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.252248 May 25 15:43:58.246983 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 313/649] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:57 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:59.138645 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9da8abf6-5763-4805-9f9e-46c7671ea1a6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:59.140033 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9da8abf6-5763-4805-9f9e-46c7671ea1a6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:59.148451 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9da8abf6-5763-4805-9f9e-46c7671ea1a6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:59.148905 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9da8abf6-5763-4805-9f9e-46c7671ea1a6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:59.149747 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9da8abf6-5763-4805-9f9e-46c7671ea1a6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:59.150184 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9da8abf6-5763-4805-9f9e-46c7671ea1a6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:59.263660 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-cb267bbb-d347-475b-ae66-7c0e224f7458 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:43:59.264920 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-cb267bbb-d347-475b-ae66-7c0e224f7458 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:43:59.273431 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cb267bbb-d347-475b-ae66-7c0e224f7458 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:59.274004 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cb267bbb-d347-475b-ae66-7c0e224f7458 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:59.274810 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cb267bbb-d347-475b-ae66-7c0e224f7458 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:59.275266 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cb267bbb-d347-475b-ae66-7c0e224f7458 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:59.387642 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9da8abf6-5763-4805-9f9e-46c7671ea1a6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:59.396954 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9da8abf6-5763-4805-9f9e-46c7671ea1a6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1509 microversion: 2.1 time: 0.263410 May 25 15:43:59.397714 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 337/650] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:59 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:43:59.513278 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cb267bbb-d347-475b-ae66-7c0e224f7458 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:43:59.522996 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-cb267bbb-d347-475b-ae66-7c0e224f7458 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.263298 May 25 15:43:59.523765 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 314/651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:43:59 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:44:00.413592 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-48f8d952-e05c-4471-9226-10a679e844fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:00.414242 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-48f8d952-e05c-4471-9226-10a679e844fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:00.421731 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-48f8d952-e05c-4471-9226-10a679e844fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:00.422188 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-48f8d952-e05c-4471-9226-10a679e844fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:00.423134 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-48f8d952-e05c-4471-9226-10a679e844fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:00.423747 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-48f8d952-e05c-4471-9226-10a679e844fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:00.541824 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9a16cf48-7066-48e7-8c67-f95c415729b3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:00.543098 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9a16cf48-7066-48e7-8c67-f95c415729b3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:00.554586 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9a16cf48-7066-48e7-8c67-f95c415729b3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:00.555463 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9a16cf48-7066-48e7-8c67-f95c415729b3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:00.556537 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9a16cf48-7066-48e7-8c67-f95c415729b3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:00.557163 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9a16cf48-7066-48e7-8c67-f95c415729b3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:00.637223 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-48f8d952-e05c-4471-9226-10a679e844fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:00.647077 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-48f8d952-e05c-4471-9226-10a679e844fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1509 microversion: 2.1 time: 0.237174 May 25 15:44:00.648264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 338/652] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:00 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1509 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:00.936167 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9a16cf48-7066-48e7-8c67-f95c415729b3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:00.939297 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9a16cf48-7066-48e7-8c67-f95c415729b3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.402683 May 25 15:44:00.941481 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 315/653] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:00 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:44:01.642816 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-3142905d-66b7-44a7-a30a-312d42fb75ec req-aa8e161c-99b7-4448-a0d3-3ebdfdb97c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a5442b-0f3d-41d4-b44f-74e483852fda", "name": "network-vif-deleted", "tag": "58598550-b0ed-4b7c-a4d8-2e58f345261c"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:44:01.644504 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:44:01.644504 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:44:01.657110 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-3142905d-66b7-44a7-a30a-312d42fb75ec req-aa8e161c-99b7-4448-a0d3-3ebdfdb97c18 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:01.657995 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-3142905d-66b7-44a7-a30a-312d42fb75ec req-aa8e161c-99b7-4448-a0d3-3ebdfdb97c18 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:01.666393 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5381f67a-a6fe-4d37-947e-6ab4238d6774 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:01.668461 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5381f67a-a6fe-4d37-947e-6ab4238d6774 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:01.682173 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-3142905d-66b7-44a7-a30a-312d42fb75ec req-aa8e161c-99b7-4448-a0d3-3ebdfdb97c18 service nova] Creating event network-vif-deleted:58598550-b0ed-4b7c-a4d8-2e58f345261c for instance 80a5442b-0f3d-41d4-b44f-74e483852fda on hv-cinder-79123 May 25 15:44:01.682666 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5381f67a-a6fe-4d37-947e-6ab4238d6774 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:01.683357 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5381f67a-a6fe-4d37-947e-6ab4238d6774 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:01.684377 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5381f67a-a6fe-4d37-947e-6ab4238d6774 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:01.685037 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5381f67a-a6fe-4d37-947e-6ab4238d6774 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:01.690455 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-3142905d-66b7-44a7-a30a-312d42fb75ec req-aa8e161c-99b7-4448-a0d3-3ebdfdb97c18 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050332 May 25 15:44:01.691790 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 339/654] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:44:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:44:01.846898 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5381f67a-a6fe-4d37-947e-6ab4238d6774 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:01.857397 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5381f67a-a6fe-4d37-947e-6ab4238d6774 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 200 len: 1293 microversion: 2.1 time: 0.194919 May 25 15:44:01.858237 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 316/655] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:01 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 1293 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:01.959264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-95456a88-150c-4b30-bda2-d8983af29115 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:01.960079 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-95456a88-150c-4b30-bda2-d8983af29115 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:01.968397 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-95456a88-150c-4b30-bda2-d8983af29115 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:01.968858 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-95456a88-150c-4b30-bda2-d8983af29115 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:01.969718 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-95456a88-150c-4b30-bda2-d8983af29115 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:01.970231 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-95456a88-150c-4b30-bda2-d8983af29115 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:02.189597 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-95456a88-150c-4b30-bda2-d8983af29115 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:02.200043 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-95456a88-150c-4b30-bda2-d8983af29115 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1756 microversion: 2.1 time: 0.245576 May 25 15:44:02.201218 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 340/656] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:01 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:02.874176 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1aa8faee-93a4-40ec-94a6-580e8ac5c54e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:02.875492 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1aa8faee-93a4-40ec-94a6-580e8ac5c54e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 80a5442b-0f3d-41d4-b44f-74e483852fda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:02.883282 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1aa8faee-93a4-40ec-94a6-580e8ac5c54e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:02.883741 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1aa8faee-93a4-40ec-94a6-580e8ac5c54e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:02.884599 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1aa8faee-93a4-40ec-94a6-580e8ac5c54e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:02.885044 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1aa8faee-93a4-40ec-94a6-580e8ac5c54e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:02.941762 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-1aa8faee-93a4-40ec-94a6-580e8ac5c54e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] HTTP exception thrown: Instance 80a5442b-0f3d-41d4-b44f-74e483852fda could not be found. May 25 15:44:02.943958 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1aa8faee-93a4-40ec-94a6-580e8ac5c54e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Returning 404 to user: Instance 80a5442b-0f3d-41d4-b44f-74e483852fda could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:44:02.945004 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1aa8faee-93a4-40ec-94a6-580e8ac5c54e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda" status: 404 len: 111 microversion: 2.1 time: 0.074587 May 25 15:44:02.946028 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 317/657] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:02 2021] GET /compute/v2.1/servers/80a5442b-0f3d-41d4-b44f-74e483852fda => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:44:02.957283 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-60db453c-3fce-4638-84c2-80b134b5961d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:02.958169 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-60db453c-3fce-4638-84c2-80b134b5961d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:02.972542 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-60db453c-3fce-4638-84c2-80b134b5961d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:02.980347 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-60db453c-3fce-4638-84c2-80b134b5961d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:02.981566 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-60db453c-3fce-4638-84c2-80b134b5961d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:02.982038 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-60db453c-3fce-4638-84c2-80b134b5961d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:03.049057 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-60db453c-3fce-4638-84c2-80b134b5961d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Going to try to terminate instance {{(pid=112576) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:44:03.185753 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-60db453c-3fce-4638-84c2-80b134b5961d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 204 len: 0 microversion: 2.1 time: 0.234182 May 25 15:44:03.186292 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 341/658] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:44:02 2021] DELETE /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:44:03.195225 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b95d183f-dbf1-443d-b774-a26ae3364fc9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:03.196119 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b95d183f-dbf1-443d-b774-a26ae3364fc9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:03.204427 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b95d183f-dbf1-443d-b774-a26ae3364fc9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:03.205177 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b95d183f-dbf1-443d-b774-a26ae3364fc9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:03.206740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b95d183f-dbf1-443d-b774-a26ae3364fc9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:03.207423 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b95d183f-dbf1-443d-b774-a26ae3364fc9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:03.222067 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c56455df-4183-465d-b308-a3d50e851a05 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:03.222777 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c56455df-4183-465d-b308-a3d50e851a05 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:03.233503 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c56455df-4183-465d-b308-a3d50e851a05 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:03.234358 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c56455df-4183-465d-b308-a3d50e851a05 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:03.235571 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c56455df-4183-465d-b308-a3d50e851a05 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:03.236204 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c56455df-4183-465d-b308-a3d50e851a05 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:03.453333 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b95d183f-dbf1-443d-b774-a26ae3364fc9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:03.463612 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b95d183f-dbf1-443d-b774-a26ae3364fc9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.272976 May 25 15:44:03.464666 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 318/659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:03 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:03.487033 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c56455df-4183-465d-b308-a3d50e851a05 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:03.496825 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c56455df-4183-465d-b308-a3d50e851a05 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1759 microversion: 2.1 time: 0.280208 May 25 15:44:03.497721 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 342/660] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:03 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1759 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:04.482142 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7fe7c5cf-0cde-4393-b92a-fdbdef31dc7f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:04.482818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7fe7c5cf-0cde-4393-b92a-fdbdef31dc7f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:04.494660 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7fe7c5cf-0cde-4393-b92a-fdbdef31dc7f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:04.495122 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7fe7c5cf-0cde-4393-b92a-fdbdef31dc7f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:04.496108 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7fe7c5cf-0cde-4393-b92a-fdbdef31dc7f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:04.496772 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7fe7c5cf-0cde-4393-b92a-fdbdef31dc7f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:04.734513 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7fe7c5cf-0cde-4393-b92a-fdbdef31dc7f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:04.750510 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7fe7c5cf-0cde-4393-b92a-fdbdef31dc7f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.271013 May 25 15:44:04.760246 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 319/661] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:04 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:05.770822 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d14911ef-f0c2-4cd1-ab73-40c7be0c2acb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:05.771597 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d14911ef-f0c2-4cd1-ab73-40c7be0c2acb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:05.779707 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d14911ef-f0c2-4cd1-ab73-40c7be0c2acb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:05.780312 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d14911ef-f0c2-4cd1-ab73-40c7be0c2acb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:05.781538 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d14911ef-f0c2-4cd1-ab73-40c7be0c2acb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:05.781993 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d14911ef-f0c2-4cd1-ab73-40c7be0c2acb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:06.005163 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d14911ef-f0c2-4cd1-ab73-40c7be0c2acb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:06.017962 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d14911ef-f0c2-4cd1-ab73-40c7be0c2acb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.252067 May 25 15:44:06.019136 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 343/662] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:05 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:07.036691 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-cbe3753a-070f-4a46-a43d-c76cb34eedaa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:07.037326 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-cbe3753a-070f-4a46-a43d-c76cb34eedaa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:07.044826 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cbe3753a-070f-4a46-a43d-c76cb34eedaa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:07.045289 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cbe3753a-070f-4a46-a43d-c76cb34eedaa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:07.046226 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cbe3753a-070f-4a46-a43d-c76cb34eedaa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:07.046662 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cbe3753a-070f-4a46-a43d-c76cb34eedaa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:07.355301 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cbe3753a-070f-4a46-a43d-c76cb34eedaa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:07.364475 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-cbe3753a-070f-4a46-a43d-c76cb34eedaa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.332395 May 25 15:44:07.365061 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 320/663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:07 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:08.383739 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d8378cf8-b242-419e-be81-fac8857b9976 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:08.384320 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d8378cf8-b242-419e-be81-fac8857b9976 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:08.392591 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d8378cf8-b242-419e-be81-fac8857b9976 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:08.393059 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d8378cf8-b242-419e-be81-fac8857b9976 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:08.393912 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d8378cf8-b242-419e-be81-fac8857b9976 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:08.394367 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d8378cf8-b242-419e-be81-fac8857b9976 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:08.604658 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d8378cf8-b242-419e-be81-fac8857b9976 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:08.613826 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d8378cf8-b242-419e-be81-fac8857b9976 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.234106 May 25 15:44:08.614530 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 344/664] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:08 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:09.630662 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0dbf71bd-d895-4752-b37d-ef0e3e096acf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:09.631288 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0dbf71bd-d895-4752-b37d-ef0e3e096acf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:09.638886 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0dbf71bd-d895-4752-b37d-ef0e3e096acf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:09.639278 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0dbf71bd-d895-4752-b37d-ef0e3e096acf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:09.640090 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0dbf71bd-d895-4752-b37d-ef0e3e096acf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:09.640541 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0dbf71bd-d895-4752-b37d-ef0e3e096acf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:09.885203 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0dbf71bd-d895-4752-b37d-ef0e3e096acf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:09.894610 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0dbf71bd-d895-4752-b37d-ef0e3e096acf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.267620 May 25 15:44:09.895117 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 321/665] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:09 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:10.910649 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-58e1697e-0f28-4717-a8b8-7d5ae1016613 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:10.911276 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-58e1697e-0f28-4717-a8b8-7d5ae1016613 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:10.918514 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-58e1697e-0f28-4717-a8b8-7d5ae1016613 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:10.918969 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-58e1697e-0f28-4717-a8b8-7d5ae1016613 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:10.919752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-58e1697e-0f28-4717-a8b8-7d5ae1016613 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:10.920222 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-58e1697e-0f28-4717-a8b8-7d5ae1016613 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:11.116753 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-58e1697e-0f28-4717-a8b8-7d5ae1016613 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:11.125008 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-58e1697e-0f28-4717-a8b8-7d5ae1016613 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.218099 May 25 15:44:11.125575 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 345/666] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:10 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:12.141655 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b942b8d2-dd02-405b-83f3-5f341e285e22 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:12.142410 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b942b8d2-dd02-405b-83f3-5f341e285e22 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:12.153159 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b942b8d2-dd02-405b-83f3-5f341e285e22 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:12.153615 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b942b8d2-dd02-405b-83f3-5f341e285e22 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:12.154796 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b942b8d2-dd02-405b-83f3-5f341e285e22 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:12.155244 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b942b8d2-dd02-405b-83f3-5f341e285e22 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:12.500862 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b942b8d2-dd02-405b-83f3-5f341e285e22 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:12.509544 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b942b8d2-dd02-405b-83f3-5f341e285e22 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.371687 May 25 15:44:12.510128 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 322/667] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:12 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:13.526962 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6c600811-f66e-40dc-a669-b7cc8d918d3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:13.527597 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6c600811-f66e-40dc-a669-b7cc8d918d3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:13.536415 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6c600811-f66e-40dc-a669-b7cc8d918d3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:13.536903 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6c600811-f66e-40dc-a669-b7cc8d918d3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:13.537959 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6c600811-f66e-40dc-a669-b7cc8d918d3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:13.538377 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6c600811-f66e-40dc-a669-b7cc8d918d3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:13.760070 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6c600811-f66e-40dc-a669-b7cc8d918d3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:13.770161 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6c600811-f66e-40dc-a669-b7cc8d918d3a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1522 microversion: 2.1 time: 0.247374 May 25 15:44:13.770954 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 346/668] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:13 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:14.254428 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-74c6da9a-0639-436f-8aa6-449794130828 req-8eac36f4-2610-47e6-8c6a-e3cf7bcdef9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b62e88c-87e4-4020-9fc4-9b2cffdc55de", "name": "network-vif-deleted", "tag": "62bd6a93-b70f-4e83-a70a-9b823ecbd7dc"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:44:14.256849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:44:14.256849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:44:14.269303 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-74c6da9a-0639-436f-8aa6-449794130828 req-8eac36f4-2610-47e6-8c6a-e3cf7bcdef9c service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:14.269958 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-74c6da9a-0639-436f-8aa6-449794130828 req-8eac36f4-2610-47e6-8c6a-e3cf7bcdef9c service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:14.292147 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-74c6da9a-0639-436f-8aa6-449794130828 req-8eac36f4-2610-47e6-8c6a-e3cf7bcdef9c service nova] Creating event network-vif-deleted:62bd6a93-b70f-4e83-a70a-9b823ecbd7dc for instance 1b62e88c-87e4-4020-9fc4-9b2cffdc55de on hv-cinder-79123 May 25 15:44:14.300207 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-74c6da9a-0639-436f-8aa6-449794130828 req-8eac36f4-2610-47e6-8c6a-e3cf7bcdef9c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048187 May 25 15:44:14.300758 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 323/669] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:44:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:44:14.786481 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5c511329-4a56-4eca-8892-fe9ed467a934 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:14.787096 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5c511329-4a56-4eca-8892-fe9ed467a934 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:14.794686 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5c511329-4a56-4eca-8892-fe9ed467a934 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:14.795137 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5c511329-4a56-4eca-8892-fe9ed467a934 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:14.795957 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5c511329-4a56-4eca-8892-fe9ed467a934 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:14.796370 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5c511329-4a56-4eca-8892-fe9ed467a934 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:14.867820 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5c511329-4a56-4eca-8892-fe9ed467a934 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:14.868380 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5c511329-4a56-4eca-8892-fe9ed467a934 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:14.868911 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-5c511329-4a56-4eca-8892-fe9ed467a934 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lazy-loading 'fault' on Instance uuid 1b62e88c-87e4-4020-9fc4-9b2cffdc55de {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:44:14.939462 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5c511329-4a56-4eca-8892-fe9ed467a934 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f0526790a544fe8db7acb862c3ccd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:14.951136 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5c511329-4a56-4eca-8892-fe9ed467a934 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 200 len: 1312 microversion: 2.1 time: 0.168347 May 25 15:44:14.952203 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 347/670] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:14 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:15.968539 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e2d4a908-1190-4525-87fe-2f84322dfaa2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:15.969415 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e2d4a908-1190-4525-87fe-2f84322dfaa2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] [instance: 1b62e88c-87e4-4020-9fc4-9b2cffdc55de] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:15.978044 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e2d4a908-1190-4525-87fe-2f84322dfaa2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:15.978499 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e2d4a908-1190-4525-87fe-2f84322dfaa2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:15.979275 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e2d4a908-1190-4525-87fe-2f84322dfaa2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:15.979719 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e2d4a908-1190-4525-87fe-2f84322dfaa2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:16.029137 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-e2d4a908-1190-4525-87fe-2f84322dfaa2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] HTTP exception thrown: Instance 1b62e88c-87e4-4020-9fc4-9b2cffdc55de could not be found. May 25 15:44:16.029747 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e2d4a908-1190-4525-87fe-2f84322dfaa2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Returning 404 to user: Instance 1b62e88c-87e4-4020-9fc4-9b2cffdc55de could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:44:16.030591 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e2d4a908-1190-4525-87fe-2f84322dfaa2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de" status: 404 len: 111 microversion: 2.1 time: 0.066210 May 25 15:44:16.031165 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 324/671] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:15 2021] GET /compute/v2.1/servers/1b62e88c-87e4-4020-9fc4-9b2cffdc55de => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:44:20.610096 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-20a631ec-67d7-40bb-b099-b9a7a29dfddb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:20.610701 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-20a631ec-67d7-40bb-b099-b9a7a29dfddb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:20.618718 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-20a631ec-67d7-40bb-b099-b9a7a29dfddb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:20.619290 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-20a631ec-67d7-40bb-b099-b9a7a29dfddb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:20.620110 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-20a631ec-67d7-40bb-b099-b9a7a29dfddb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:20.620550 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-20a631ec-67d7-40bb-b099-b9a7a29dfddb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:20.781719 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-20a631ec-67d7-40bb-b099-b9a7a29dfddb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lazy-loading 'services' on Instance uuid 92aed9d5-56b6-4cbf-9678-b16f7de68b23 {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:44:20.919649 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-20a631ec-67d7-40bb-b099-b9a7a29dfddb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/os-volume_attachments/fd0edb17-77cc-4d9f-b4d9-a0be55921a91" status: 202 len: 0 microversion: 2.1 time: 0.313394 May 25 15:44:20.920281 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 348/672] 10.222.0.36 () {58 vars in 1416 bytes} [Tue May 25 15:44:20 2021] DELETE /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/os-volume_attachments/fd0edb17-77cc-4d9f-b4d9-a0be55921a91 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:44:23.218334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-41f4f868-4d04-4a8e-ab5b-01fd6acce9cc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:44:23.227950 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-41f4f868-4d04-4a8e-ab5b-01fd6acce9cc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:23.228702 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-41f4f868-4d04-4a8e-ab5b-01fd6acce9cc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:23.291655 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-41f4f868-4d04-4a8e-ab5b-01fd6acce9cc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Going to try to stop instance {{(pid=112577) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 25 15:44:23.382029 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-41f4f868-4d04-4a8e-ab5b-01fd6acce9cc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 202 len: 0 microversion: 2.1 time: 0.167890 May 25 15:44:23.382984 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 325/673] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:44:23 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:44:23.392219 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-292cea8f-4126-46a1-aa66-da3b29a6feef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:23.393602 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-292cea8f-4126-46a1-aa66-da3b29a6feef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:23.403990 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-292cea8f-4126-46a1-aa66-da3b29a6feef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:23.405062 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-292cea8f-4126-46a1-aa66-da3b29a6feef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:23.406292 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-292cea8f-4126-46a1-aa66-da3b29a6feef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:23.406781 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-292cea8f-4126-46a1-aa66-da3b29a6feef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:23.643187 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-292cea8f-4126-46a1-aa66-da3b29a6feef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:23.653386 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-292cea8f-4126-46a1-aa66-da3b29a6feef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.265971 May 25 15:44:23.653966 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 349/674] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:23 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:24.674934 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e18daf91-ccf9-4e76-85c3-a0c05b18b2e0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:24.676948 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e18daf91-ccf9-4e76-85c3-a0c05b18b2e0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:24.685289 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e18daf91-ccf9-4e76-85c3-a0c05b18b2e0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:24.686128 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e18daf91-ccf9-4e76-85c3-a0c05b18b2e0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:24.687095 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e18daf91-ccf9-4e76-85c3-a0c05b18b2e0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:24.687848 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e18daf91-ccf9-4e76-85c3-a0c05b18b2e0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:24.908732 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e18daf91-ccf9-4e76-85c3-a0c05b18b2e0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:24.920054 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e18daf91-ccf9-4e76-85c3-a0c05b18b2e0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.250228 May 25 15:44:24.920749 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 326/675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:24 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:25.939586 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d49823f5-9cda-451d-ac95-826dd4b0ef87 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:25.940969 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d49823f5-9cda-451d-ac95-826dd4b0ef87 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:25.949761 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d49823f5-9cda-451d-ac95-826dd4b0ef87 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:25.950304 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d49823f5-9cda-451d-ac95-826dd4b0ef87 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:25.951212 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d49823f5-9cda-451d-ac95-826dd4b0ef87 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:25.952286 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d49823f5-9cda-451d-ac95-826dd4b0ef87 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:26.176375 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d49823f5-9cda-451d-ac95-826dd4b0ef87 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:26.185278 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d49823f5-9cda-451d-ac95-826dd4b0ef87 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.250939 May 25 15:44:26.185962 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 350/676] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:25 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:27.203207 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-247078f6-4acc-4cd7-b955-e4c072bcadad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:27.203959 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-247078f6-4acc-4cd7-b955-e4c072bcadad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:27.211657 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-247078f6-4acc-4cd7-b955-e4c072bcadad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:27.212154 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-247078f6-4acc-4cd7-b955-e4c072bcadad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:27.213268 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-247078f6-4acc-4cd7-b955-e4c072bcadad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:27.213793 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-247078f6-4acc-4cd7-b955-e4c072bcadad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:27.497292 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-247078f6-4acc-4cd7-b955-e4c072bcadad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:27.506039 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-247078f6-4acc-4cd7-b955-e4c072bcadad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.307255 May 25 15:44:27.516345 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 327/677] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:27 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:28.522432 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e687f528-c96b-451b-bd54-e9a596da069c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:28.523054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e687f528-c96b-451b-bd54-e9a596da069c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:28.530691 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e687f528-c96b-451b-bd54-e9a596da069c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:28.531194 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e687f528-c96b-451b-bd54-e9a596da069c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:28.531962 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e687f528-c96b-451b-bd54-e9a596da069c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:28.532404 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e687f528-c96b-451b-bd54-e9a596da069c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:28.741320 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-e687f528-c96b-451b-bd54-e9a596da069c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:28.750183 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e687f528-c96b-451b-bd54-e9a596da069c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.231394 May 25 15:44:28.754314 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 351/678] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:28 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:29.769773 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b49266f1-a01f-4097-a966-4a2ec62ce07e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:29.770484 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b49266f1-a01f-4097-a966-4a2ec62ce07e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:29.779245 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b49266f1-a01f-4097-a966-4a2ec62ce07e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:29.779708 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b49266f1-a01f-4097-a966-4a2ec62ce07e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:29.780543 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b49266f1-a01f-4097-a966-4a2ec62ce07e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:29.781081 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b49266f1-a01f-4097-a966-4a2ec62ce07e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:30.157347 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b49266f1-a01f-4097-a966-4a2ec62ce07e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:30.165662 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b49266f1-a01f-4097-a966-4a2ec62ce07e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.402157 May 25 15:44:30.166228 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 328/679] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:29 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:31.182632 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-93eb1707-d9e0-4620-a7fc-2c9d27ef8033 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:31.183521 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-93eb1707-d9e0-4620-a7fc-2c9d27ef8033 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:31.192326 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-93eb1707-d9e0-4620-a7fc-2c9d27ef8033 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:31.193304 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-93eb1707-d9e0-4620-a7fc-2c9d27ef8033 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:31.194113 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-93eb1707-d9e0-4620-a7fc-2c9d27ef8033 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:31.194560 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-93eb1707-d9e0-4620-a7fc-2c9d27ef8033 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:31.418171 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-93eb1707-d9e0-4620-a7fc-2c9d27ef8033 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:31.426677 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-93eb1707-d9e0-4620-a7fc-2c9d27ef8033 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.247939 May 25 15:44:31.427256 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 352/680] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:31 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:32.444226 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b5a3a653-72ec-48ff-a784-9766af35ab04 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:32.445065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b5a3a653-72ec-48ff-a784-9766af35ab04 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:32.453622 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b5a3a653-72ec-48ff-a784-9766af35ab04 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:32.454100 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b5a3a653-72ec-48ff-a784-9766af35ab04 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:32.455124 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b5a3a653-72ec-48ff-a784-9766af35ab04 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:32.455566 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b5a3a653-72ec-48ff-a784-9766af35ab04 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:32.808451 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b5a3a653-72ec-48ff-a784-9766af35ab04 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:32.817485 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b5a3a653-72ec-48ff-a784-9766af35ab04 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.377733 May 25 15:44:32.818062 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 329/681] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:32 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:33.837501 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1e5a2c3d-cf26-49d9-bfc7-44d25c320ccc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:33.838776 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1e5a2c3d-cf26-49d9-bfc7-44d25c320ccc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:33.846621 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1e5a2c3d-cf26-49d9-bfc7-44d25c320ccc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:33.847573 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1e5a2c3d-cf26-49d9-bfc7-44d25c320ccc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:33.848623 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1e5a2c3d-cf26-49d9-bfc7-44d25c320ccc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:33.849384 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1e5a2c3d-cf26-49d9-bfc7-44d25c320ccc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:34.442864 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1e5a2c3d-cf26-49d9-bfc7-44d25c320ccc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:34.456077 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1e5a2c3d-cf26-49d9-bfc7-44d25c320ccc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.624743 May 25 15:44:34.456844 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 353/682] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:33 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:35.475154 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8cdd1439-e8a1-4bba-93c2-babd331270e9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:35.475607 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8cdd1439-e8a1-4bba-93c2-babd331270e9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:35.483208 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8cdd1439-e8a1-4bba-93c2-babd331270e9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:35.483664 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8cdd1439-e8a1-4bba-93c2-babd331270e9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:35.484548 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8cdd1439-e8a1-4bba-93c2-babd331270e9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:35.485163 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8cdd1439-e8a1-4bba-93c2-babd331270e9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:35.799315 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-8cdd1439-e8a1-4bba-93c2-babd331270e9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:35.815584 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8cdd1439-e8a1-4bba-93c2-babd331270e9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.344455 May 25 15:44:35.845999 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 330/683] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:35 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:36.863328 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2f900137-75f7-4e74-b8ff-859984257be3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:36.864067 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2f900137-75f7-4e74-b8ff-859984257be3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:36.871450 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f900137-75f7-4e74-b8ff-859984257be3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:36.872170 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f900137-75f7-4e74-b8ff-859984257be3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:36.872989 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f900137-75f7-4e74-b8ff-859984257be3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:36.873435 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f900137-75f7-4e74-b8ff-859984257be3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:37.421418 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2f900137-75f7-4e74-b8ff-859984257be3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:37.429909 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2f900137-75f7-4e74-b8ff-859984257be3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.571100 May 25 15:44:37.430482 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 354/684] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:36 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:38.448902 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4b7c0602-e7ec-4a8d-8ddd-5534f7ef6733 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:38.449540 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4b7c0602-e7ec-4a8d-8ddd-5534f7ef6733 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:38.462949 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4b7c0602-e7ec-4a8d-8ddd-5534f7ef6733 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:38.464553 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4b7c0602-e7ec-4a8d-8ddd-5534f7ef6733 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:38.466264 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4b7c0602-e7ec-4a8d-8ddd-5534f7ef6733 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:38.466931 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4b7c0602-e7ec-4a8d-8ddd-5534f7ef6733 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:38.713853 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4b7c0602-e7ec-4a8d-8ddd-5534f7ef6733 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:38.743401 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4b7c0602-e7ec-4a8d-8ddd-5534f7ef6733 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.300017 May 25 15:44:38.744385 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 331/685] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:38 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:39.640877 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f261409e-d847-4f3b-84cc-79eee0003e8c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Action: 'create', calling method: .version_select at 0x7f08847c3ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2103351507"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:44:39.664159 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-f261409e-d847-4f3b-84cc-79eee0003e8c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Getting quotas for project 9276d22c6df545f2a056d5059899b85f. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:44:39.668345 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-f261409e-d847-4f3b-84cc-79eee0003e8c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Getting quotas for user 279538b4ffde4d39a352b2594cc4bd21 and project 9276d22c6df545f2a056d5059899b85f. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:44:39.762936 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-44cc4960-8177-488d-8552-228d3d08ecca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:39.764279 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-44cc4960-8177-488d-8552-228d3d08ecca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:39.771953 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-44cc4960-8177-488d-8552-228d3d08ecca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:39.772460 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-44cc4960-8177-488d-8552-228d3d08ecca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:39.773335 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-44cc4960-8177-488d-8552-228d3d08ecca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:39.773858 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-44cc4960-8177-488d-8552-228d3d08ecca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:39.787804 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-f261409e-d847-4f3b-84cc-79eee0003e8c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Getting quotas for project 9276d22c6df545f2a056d5059899b85f. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:44:39.794133 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-f261409e-d847-4f3b-84cc-79eee0003e8c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Getting quotas for user 279538b4ffde4d39a352b2594cc4bd21 and project 9276d22c6df545f2a056d5059899b85f. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:44:39.808811 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f261409e-d847-4f3b-84cc-79eee0003e8c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.365279 May 25 15:44:39.809722 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 355/686] 10.222.0.36 () {60 vars in 1158 bytes} [Tue May 25 15:44:39 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:40.006736 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-44cc4960-8177-488d-8552-228d3d08ecca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:40.016940 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-44cc4960-8177-488d-8552-228d3d08ecca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.258589 May 25 15:44:40.017530 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 332/687] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:39 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:44:41.034486 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-19a99ba9-bf0e-4acd-b18c-28a1b22669f0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:41.035128 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-19a99ba9-bf0e-4acd-b18c-28a1b22669f0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:41.044422 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-19a99ba9-bf0e-4acd-b18c-28a1b22669f0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:41.044885 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-19a99ba9-bf0e-4acd-b18c-28a1b22669f0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:41.045685 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-19a99ba9-bf0e-4acd-b18c-28a1b22669f0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:41.046136 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-19a99ba9-bf0e-4acd-b18c-28a1b22669f0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:41.248034 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-19a99ba9-bf0e-4acd-b18c-28a1b22669f0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:41.256940 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-19a99ba9-bf0e-4acd-b18c-28a1b22669f0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.226099 May 25 15:44:41.267490 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 356/688] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:41 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:42.274643 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fe47e5df-9dd2-4f49-ac0b-894d200017d6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:42.275276 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fe47e5df-9dd2-4f49-ac0b-894d200017d6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:42.282605 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fe47e5df-9dd2-4f49-ac0b-894d200017d6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:42.283066 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fe47e5df-9dd2-4f49-ac0b-894d200017d6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:42.284384 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fe47e5df-9dd2-4f49-ac0b-894d200017d6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:42.284832 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fe47e5df-9dd2-4f49-ac0b-894d200017d6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:42.485527 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-fe47e5df-9dd2-4f49-ac0b-894d200017d6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:42.496357 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fe47e5df-9dd2-4f49-ac0b-894d200017d6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.225317 May 25 15:44:42.496939 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 333/689] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:42 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:43.513721 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-22093a9b-17e5-43fc-bb05-ca0b2f0d1b4f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:43.515092 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-22093a9b-17e5-43fc-bb05-ca0b2f0d1b4f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:43.519948 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8cfd368-3915-4a96-967c-9e88d94a5018] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 25 15:44:43.526022 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-22093a9b-17e5-43fc-bb05-ca0b2f0d1b4f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:43.526757 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-22093a9b-17e5-43fc-bb05-ca0b2f0d1b4f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:43.527813 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-22093a9b-17e5-43fc-bb05-ca0b2f0d1b4f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:43.528395 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-22093a9b-17e5-43fc-bb05-ca0b2f0d1b4f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:43.738718 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-22093a9b-17e5-43fc-bb05-ca0b2f0d1b4f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:43.747190 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-22093a9b-17e5-43fc-bb05-ca0b2f0d1b4f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1676 microversion: 2.1 time: 0.237506 May 25 15:44:43.757320 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 357/690] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:43 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:44.764604 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f419d3b8-d310-4795-b6eb-e2f21e3b7c2b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:44.765192 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f419d3b8-d310-4795-b6eb-e2f21e3b7c2b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:44.773294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f419d3b8-d310-4795-b6eb-e2f21e3b7c2b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:44.773748 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f419d3b8-d310-4795-b6eb-e2f21e3b7c2b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:44.774542 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f419d3b8-d310-4795-b6eb-e2f21e3b7c2b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:44.774990 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f419d3b8-d310-4795-b6eb-e2f21e3b7c2b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:44.976949 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f419d3b8-d310-4795-b6eb-e2f21e3b7c2b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:44.985141 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f419d3b8-d310-4795-b6eb-e2f21e3b7c2b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1653 microversion: 2.1 time: 0.224714 May 25 15:44:44.985696 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 334/691] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:44 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1653 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:45.001728 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:44:45.021423 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:45.021937 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:45.076550 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8cfd368-3915-4a96-967c-9e88d94a5018] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47480. May 25 15:44:45.081952 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Going to try to start instance {{(pid=112576) start /opt/stack/nova/nova/compute/api.py:2602}} May 25 15:44:45.167447 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action" status: 202 len: 0 microversion: 2.1 time: 0.169030 May 25 15:44:45.168194 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 358/692] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:44:44 2021] POST /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:44:45.177093 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-be5842cc-6bfd-4b64-bd53-5fd4548a39c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:45.177642 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-be5842cc-6bfd-4b64-bd53-5fd4548a39c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:45.185197 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-be5842cc-6bfd-4b64-bd53-5fd4548a39c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:45.185889 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-be5842cc-6bfd-4b64-bd53-5fd4548a39c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:45.187037 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-be5842cc-6bfd-4b64-bd53-5fd4548a39c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:45.187503 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-be5842cc-6bfd-4b64-bd53-5fd4548a39c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:45.479451 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-be5842cc-6bfd-4b64-bd53-5fd4548a39c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:45.490647 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-be5842cc-6bfd-4b64-bd53-5fd4548a39c7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1662 microversion: 2.1 time: 0.317814 May 25 15:44:45.491814 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 335/693] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:45 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1662 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:46.511399 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2e73feb4-37d3-4a03-be9b-9d07201058a6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:46.513083 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2e73feb4-37d3-4a03-be9b-9d07201058a6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:46.520890 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2e73feb4-37d3-4a03-be9b-9d07201058a6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:46.521220 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2e73feb4-37d3-4a03-be9b-9d07201058a6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:46.522005 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2e73feb4-37d3-4a03-be9b-9d07201058a6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:46.522604 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2e73feb4-37d3-4a03-be9b-9d07201058a6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:46.730809 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2e73feb4-37d3-4a03-be9b-9d07201058a6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:46.739517 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2e73feb4-37d3-4a03-be9b-9d07201058a6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1662 microversion: 2.1 time: 0.233802 May 25 15:44:46.740133 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 359/694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:46 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1662 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:47.756768 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5e8b4481-bb94-4c6a-b1d0-9763d14be6e5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:47.757514 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5e8b4481-bb94-4c6a-b1d0-9763d14be6e5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:47.765152 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5e8b4481-bb94-4c6a-b1d0-9763d14be6e5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:47.765613 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5e8b4481-bb94-4c6a-b1d0-9763d14be6e5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:47.766445 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5e8b4481-bb94-4c6a-b1d0-9763d14be6e5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:47.766883 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5e8b4481-bb94-4c6a-b1d0-9763d14be6e5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:47.963723 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5e8b4481-bb94-4c6a-b1d0-9763d14be6e5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:47.973183 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5e8b4481-bb94-4c6a-b1d0-9763d14be6e5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1662 microversion: 2.1 time: 0.220021 May 25 15:44:47.973755 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 336/695] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:47 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1662 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:48.990145 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-cbce22e6-063f-46a6-ada7-31acf0cc3700 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:48.990768 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-cbce22e6-063f-46a6-ada7-31acf0cc3700 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:48.998290 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cbce22e6-063f-46a6-ada7-31acf0cc3700 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:48.998764 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cbce22e6-063f-46a6-ada7-31acf0cc3700 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:48.999739 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cbce22e6-063f-46a6-ada7-31acf0cc3700 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:49.000225 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cbce22e6-063f-46a6-ada7-31acf0cc3700 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:49.312770 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-cbce22e6-063f-46a6-ada7-31acf0cc3700 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:49.321663 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-cbce22e6-063f-46a6-ada7-31acf0cc3700 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1662 microversion: 2.1 time: 0.335409 May 25 15:44:49.322231 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 360/696] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:48 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1662 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:50.339116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2f4fd888-21d9-41e3-91b6-959873f2ab95 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:50.339733 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2f4fd888-21d9-41e3-91b6-959873f2ab95 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:50.347095 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f4fd888-21d9-41e3-91b6-959873f2ab95 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:50.347546 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f4fd888-21d9-41e3-91b6-959873f2ab95 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:50.348356 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f4fd888-21d9-41e3-91b6-959873f2ab95 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:50.348797 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f4fd888-21d9-41e3-91b6-959873f2ab95 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:50.608094 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2f4fd888-21d9-41e3-91b6-959873f2ab95 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:50.617026 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2f4fd888-21d9-41e3-91b6-959873f2ab95 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1662 microversion: 2.1 time: 0.281539 May 25 15:44:50.617599 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 337/697] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:50 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1662 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:51.634083 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5588bfb0-fff5-4c54-94c9-6f86756ac35c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:44:51.634740 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5588bfb0-fff5-4c54-94c9-6f86756ac35c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:44:51.643435 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5588bfb0-fff5-4c54-94c9-6f86756ac35c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:51.643974 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5588bfb0-fff5-4c54-94c9-6f86756ac35c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:51.644758 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5588bfb0-fff5-4c54-94c9-6f86756ac35c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:51.645204 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5588bfb0-fff5-4c54-94c9-6f86756ac35c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:51.841691 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5588bfb0-fff5-4c54-94c9-6f86756ac35c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:44:51.850808 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5588bfb0-fff5-4c54-94c9-6f86756ac35c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1666 microversion: 2.1 time: 0.220624 May 25 15:44:51.851460 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 361/698] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:44:51 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1666 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:44:55.998423 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:44:55.999221 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: Tue May 25 15:44:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:45:07.753191 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f6875bb-3a29-43e2-a347-230f2ec5e785] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 25 15:45:07.756963 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-902464487", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2103351507", "security_groups": [{"name": "tempest-secgroup-smoke-833018644"}], "networks": [{"uuid": "bef3b39e-4efb-47b6-ab09-ddc4c406ab32"}], "block_device_mapping_v2": [{"uuid": "7c23ea82-0ea9-4a19-80ac-14cadcc84632", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:07.930359 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] validate_networks() for [('bef3b39e-4efb-47b6-ab09-ddc4c406ab32', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:45:08.516263 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:45:08.516757 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:45:08.517276 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:45:08.517693 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:45:08.518112 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:45:08.526637 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:08.527538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:08.533937 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:08.534394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:08.552426 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Getting quotas for project 9276d22c6df545f2a056d5059899b85f. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:45:08.556342 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Getting quotas for user 279538b4ffde4d39a352b2594cc4bd21 and project 9276d22c6df545f2a056d5059899b85f. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:45:08.680588 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:45:08.683286 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c23ea82-0ea9-4a19-80ac-14cadcc84632',volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:45:08.775855 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f6875bb-3a29-43e2-a347-230f2ec5e785] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47830. May 25 15:45:08.879701 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.128160 May 25 15:45:08.880666 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 338/699] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:45:07 2021] POST /compute/v2.1/servers => generated 405 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:45:08.891037 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-76577164-fead-47cd-9ea3-89abc8b2757c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:08.892449 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-76577164-fead-47cd-9ea3-89abc8b2757c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:08.970708 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-76577164-fead-47cd-9ea3-89abc8b2757c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:08.982128 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-76577164-fead-47cd-9ea3-89abc8b2757c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1088 microversion: 2.1 time: 0.095262 May 25 15:45:08.982766 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 362/700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:08 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1088 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:09.999119 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0f651315-4e2b-473e-a276-654c305ba2b5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:09.999838 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0f651315-4e2b-473e-a276-654c305ba2b5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:10.008058 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0f651315-4e2b-473e-a276-654c305ba2b5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:10.008601 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0f651315-4e2b-473e-a276-654c305ba2b5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:10.009449 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0f651315-4e2b-473e-a276-654c305ba2b5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:10.010000 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0f651315-4e2b-473e-a276-654c305ba2b5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:10.165880 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0f651315-4e2b-473e-a276-654c305ba2b5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:10.174722 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0f651315-4e2b-473e-a276-654c305ba2b5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1186 microversion: 2.1 time: 0.178784 May 25 15:45:10.175293 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 339/701] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:09 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1186 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:11.192500 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f97a2cbd-84c1-4a3d-ad55-61e395232533 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:11.193124 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f97a2cbd-84c1-4a3d-ad55-61e395232533 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:11.200472 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f97a2cbd-84c1-4a3d-ad55-61e395232533 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:11.200937 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f97a2cbd-84c1-4a3d-ad55-61e395232533 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:11.201725 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f97a2cbd-84c1-4a3d-ad55-61e395232533 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:11.202361 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f97a2cbd-84c1-4a3d-ad55-61e395232533 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:11.316476 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f97a2cbd-84c1-4a3d-ad55-61e395232533 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:11.324796 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f97a2cbd-84c1-4a3d-ad55-61e395232533 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1204 microversion: 2.1 time: 0.136589 May 25 15:45:11.325467 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 363/702] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:11 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1204 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:12.342286 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:12.342850 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:12.350284 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:12.350747 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:12.351538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:12.352020 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:12.879763 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:12.889002 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1259 microversion: 2.1 time: 0.550633 May 25 15:45:12.889881 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 340/703] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:12 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1259 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:12.982930 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-d134f706-f882-4e80-a1d2-0b3c58b5b4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b8d3b0-aceb-4f56-a13d-7d0696f42901", "tag": "7ae06ec7-6469-494a-b223-ce3de0a0e2da"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:12.985650 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:45:12.985650 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:45:12.996236 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-d134f706-f882-4e80-a1d2-0b3c58b5b4c2 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:12.996788 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-d134f706-f882-4e80-a1d2-0b3c58b5b4c2 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:13.019528 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-d134f706-f882-4e80-a1d2-0b3c58b5b4c2 service nova] Creating event network-changed:7ae06ec7-6469-494a-b223-ce3de0a0e2da for instance a4b8d3b0-aceb-4f56-a13d-7d0696f42901 on hv-cinder-79123 May 25 15:45:13.026473 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-d134f706-f882-4e80-a1d2-0b3c58b5b4c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047466 May 25 15:45:13.027082 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 364/704] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:45:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:45:13.910081 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0659fa5a-9983-4132-8933-72c8efc21a13 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:13.910737 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0659fa5a-9983-4132-8933-72c8efc21a13 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:13.918052 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0659fa5a-9983-4132-8933-72c8efc21a13 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:13.918601 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0659fa5a-9983-4132-8933-72c8efc21a13 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:13.919514 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0659fa5a-9983-4132-8933-72c8efc21a13 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:13.920061 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0659fa5a-9983-4132-8933-72c8efc21a13 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:14.375151 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0659fa5a-9983-4132-8933-72c8efc21a13 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:14.384489 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0659fa5a-9983-4132-8933-72c8efc21a13 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1259 microversion: 2.1 time: 0.478389 May 25 15:45:14.385161 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 341/705] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:13 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1259 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:15.401954 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-782a0cbe-2686-40f5-9c19-f859448f8184 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:15.402667 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-782a0cbe-2686-40f5-9c19-f859448f8184 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:15.410596 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-782a0cbe-2686-40f5-9c19-f859448f8184 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:15.411043 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-782a0cbe-2686-40f5-9c19-f859448f8184 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:15.412392 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-782a0cbe-2686-40f5-9c19-f859448f8184 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:15.412392 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-782a0cbe-2686-40f5-9c19-f859448f8184 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:15.620008 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-782a0cbe-2686-40f5-9c19-f859448f8184 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:15.629136 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-782a0cbe-2686-40f5-9c19-f859448f8184 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1259 microversion: 2.1 time: 0.231298 May 25 15:45:15.629790 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 365/706] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:15 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:16.646199 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fca70fe4-c422-4e91-a629-b2a4932b9b03 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:16.646907 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fca70fe4-c422-4e91-a629-b2a4932b9b03 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:16.654480 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fca70fe4-c422-4e91-a629-b2a4932b9b03 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:16.654950 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fca70fe4-c422-4e91-a629-b2a4932b9b03 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:16.655753 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fca70fe4-c422-4e91-a629-b2a4932b9b03 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:16.656226 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fca70fe4-c422-4e91-a629-b2a4932b9b03 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:16.866867 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-fca70fe4-c422-4e91-a629-b2a4932b9b03 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:16.875308 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fca70fe4-c422-4e91-a629-b2a4932b9b03 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1259 microversion: 2.1 time: 0.233384 May 25 15:45:16.875885 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 342/707] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:16 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:17.893090 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-84358249-a85c-4087-b742-bd62e49ffc5b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:17.893718 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-84358249-a85c-4087-b742-bd62e49ffc5b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:17.900926 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-84358249-a85c-4087-b742-bd62e49ffc5b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:17.901383 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-84358249-a85c-4087-b742-bd62e49ffc5b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:17.902157 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-84358249-a85c-4087-b742-bd62e49ffc5b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:17.902596 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-84358249-a85c-4087-b742-bd62e49ffc5b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:18.113020 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-84358249-a85c-4087-b742-bd62e49ffc5b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:18.121270 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-84358249-a85c-4087-b742-bd62e49ffc5b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1259 microversion: 2.1 time: 0.231991 May 25 15:45:18.121831 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 366/708] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:17 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:18.661840 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-322049059"}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:18.662414 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:18.669718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:18.670163 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:18.671060 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:18.671519 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:18.865278 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.network.security_group_api [None req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Removing security group 17501c6a-8302-4871-b31d-a8c482336d39 from port c536b9e5-ae17-4775-b209-71e6ec42122a May 25 15:45:19.139286 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-eb5493e8-6443-4958-bd14-6efa67fc81a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:19.140344 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-eb5493e8-6443-4958-bd14-6efa67fc81a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:19.148327 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb5493e8-6443-4958-bd14-6efa67fc81a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:19.148977 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb5493e8-6443-4958-bd14-6efa67fc81a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:19.149858 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb5493e8-6443-4958-bd14-6efa67fc81a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:19.150414 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb5493e8-6443-4958-bd14-6efa67fc81a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:19.366318 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/action" status: 202 len: 0 microversion: 2.1 time: 0.708879 May 25 15:45:19.366931 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 343/709] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:45:18 2021] POST /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/action => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:45:19.378866 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-439fbe0a-c5db-4079-bba4-2b66d82ecb21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e39efa-e568-41dd-9368-376ead8b1020", "tag": "c536b9e5-ae17-4775-b209-71e6ec42122a"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:19.380705 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:45:19.380705 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:45:19.407471 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-439fbe0a-c5db-4079-bba4-2b66d82ecb21 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:19.410436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-439fbe0a-c5db-4079-bba4-2b66d82ecb21 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:19.463900 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-439fbe0a-c5db-4079-bba4-2b66d82ecb21 service nova] Creating event network-changed:c536b9e5-ae17-4775-b209-71e6ec42122a for instance 17e39efa-e568-41dd-9368-376ead8b1020 on hv-cinder-79123 May 25 15:45:19.475886 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-439fbe0a-c5db-4079-bba4-2b66d82ecb21 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100678 May 25 15:45:19.478377 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 344/710] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:45:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:45:19.575796 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-eb5493e8-6443-4958-bd14-6efa67fc81a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:19.589183 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-eb5493e8-6443-4958-bd14-6efa67fc81a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1259 microversion: 2.1 time: 0.454012 May 25 15:45:19.591472 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 367/711] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:19 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1259 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:20.609905 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-106b029f-24ec-4509-a883-b4101d8830db tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:20.610947 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-106b029f-24ec-4509-a883-b4101d8830db tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:20.619081 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-106b029f-24ec-4509-a883-b4101d8830db tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:20.619550 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-106b029f-24ec-4509-a883-b4101d8830db tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:20.620437 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-106b029f-24ec-4509-a883-b4101d8830db tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:20.620817 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-106b029f-24ec-4509-a883-b4101d8830db tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:20.853828 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-106b029f-24ec-4509-a883-b4101d8830db tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:20.864105 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-106b029f-24ec-4509-a883-b4101d8830db tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1259 microversion: 2.1 time: 0.258375 May 25 15:45:20.865109 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 345/712] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:20 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:21.467408 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c6c8d1a8-f2ba-41e6-b5b5-0e4eb3a2ce52 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:21.468034 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c6c8d1a8-f2ba-41e6-b5b5-0e4eb3a2ce52 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:21.476364 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c6c8d1a8-f2ba-41e6-b5b5-0e4eb3a2ce52 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:21.476901 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c6c8d1a8-f2ba-41e6-b5b5-0e4eb3a2ce52 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:21.477760 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c6c8d1a8-f2ba-41e6-b5b5-0e4eb3a2ce52 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:21.478277 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c6c8d1a8-f2ba-41e6-b5b5-0e4eb3a2ce52 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:21.598170 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-4d81efd2-0287-428d-a263-cd47254dc03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e39efa-e568-41dd-9368-376ead8b1020", "tag": "c536b9e5-ae17-4775-b209-71e6ec42122a"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:21.599941 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:45:21.599941 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:45:21.608425 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-4d81efd2-0287-428d-a263-cd47254dc03e service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:21.608942 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-4d81efd2-0287-428d-a263-cd47254dc03e service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:21.625924 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-4d81efd2-0287-428d-a263-cd47254dc03e service nova] Creating event network-changed:c536b9e5-ae17-4775-b209-71e6ec42122a for instance 17e39efa-e568-41dd-9368-376ead8b1020 on hv-cinder-79123 May 25 15:45:21.631663 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-4d81efd2-0287-428d-a263-cd47254dc03e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171514 May 25 15:45:21.632251 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 346/713] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:45:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:45:21.645647 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-c6c8d1a8-f2ba-41e6-b5b5-0e4eb3a2ce52 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lazy-loading 'services' on Instance uuid 17e39efa-e568-41dd-9368-376ead8b1020 {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:45:21.796408 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c6c8d1a8-f2ba-41e6-b5b5-0e4eb3a2ce52 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/os-volume_attachments/1aca56f5-465c-4ca6-9bc1-aa69b76f3bee" status: 202 len: 0 microversion: 2.1 time: 0.337963 May 25 15:45:21.798386 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 368/714] 10.222.0.36 () {58 vars in 1416 bytes} [Tue May 25 15:45:21 2021] DELETE /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/os-volume_attachments/1aca56f5-465c-4ca6-9bc1-aa69b76f3bee => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:45:21.806766 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8566ef48-82cc-4f93-8362-9c05a5d69f87 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:21.815908 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8566ef48-82cc-4f93-8362-9c05a5d69f87 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:21.829484 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8566ef48-82cc-4f93-8362-9c05a5d69f87 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:21.830871 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8566ef48-82cc-4f93-8362-9c05a5d69f87 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:21.831926 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8566ef48-82cc-4f93-8362-9c05a5d69f87 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:21.832594 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8566ef48-82cc-4f93-8362-9c05a5d69f87 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:21.884791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1640974f-004c-489f-ace7-ea8beee66359 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:21.885990 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1640974f-004c-489f-ace7-ea8beee66359 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:21.896882 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1640974f-004c-489f-ace7-ea8beee66359 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:21.898526 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1640974f-004c-489f-ace7-ea8beee66359 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:21.901134 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1640974f-004c-489f-ace7-ea8beee66359 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:21.901888 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1640974f-004c-489f-ace7-ea8beee66359 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:21.929314 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8566ef48-82cc-4f93-8362-9c05a5d69f87 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126676 May 25 15:45:21.943046 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 347/715] 10.222.0.36 () {58 vars in 1302 bytes} [Tue May 25 15:45:21 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:45:22.201940 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1640974f-004c-489f-ace7-ea8beee66359 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:22.212955 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1640974f-004c-489f-ace7-ea8beee66359 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1259 microversion: 2.1 time: 0.334298 May 25 15:45:22.213746 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 369/716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:21 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1259 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:22.878786 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4b48b6bb-bd18-496a-a92f-89e2f4a58966 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:22.879835 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4b48b6bb-bd18-496a-a92f-89e2f4a58966 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:22.887317 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4b48b6bb-bd18-496a-a92f-89e2f4a58966 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:22.888054 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4b48b6bb-bd18-496a-a92f-89e2f4a58966 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:22.889044 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4b48b6bb-bd18-496a-a92f-89e2f4a58966 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:22.889468 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4b48b6bb-bd18-496a-a92f-89e2f4a58966 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:22.941905 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-acfcf509-204a-4ed2-a974-6754ff3cccf7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:22.942892 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-acfcf509-204a-4ed2-a974-6754ff3cccf7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:22.955281 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-acfcf509-204a-4ed2-a974-6754ff3cccf7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:22.955742 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-acfcf509-204a-4ed2-a974-6754ff3cccf7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:22.957867 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-acfcf509-204a-4ed2-a974-6754ff3cccf7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:22.958310 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-acfcf509-204a-4ed2-a974-6754ff3cccf7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:22.958906 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4b48b6bb-bd18-496a-a92f-89e2f4a58966 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/os-volume_attachments/aec917a3-6fe8-46b5-895a-ad640bed22d9" status: 200 len: 194 microversion: 2.20 time: 0.215106 May 25 15:45:22.959583 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 348/717] 10.222.0.36 () {60 vars in 1454 bytes} [Tue May 25 15:45:22 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/os-volume_attachments/aec917a3-6fe8-46b5-895a-ad640bed22d9 => generated 194 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:45:23.027374 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-acfcf509-204a-4ed2-a974-6754ff3cccf7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089185 May 25 15:45:23.027981 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 370/718] 10.222.0.36 () {58 vars in 1302 bytes} [Tue May 25 15:45:22 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:45:23.163340 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c87fe971-6fb2-4928-86ed-873da66b5efa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:23.163841 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c87fe971-6fb2-4928-86ed-873da66b5efa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:23.176502 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c87fe971-6fb2-4928-86ed-873da66b5efa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:23.177361 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c87fe971-6fb2-4928-86ed-873da66b5efa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:23.179371 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c87fe971-6fb2-4928-86ed-873da66b5efa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:23.180045 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c87fe971-6fb2-4928-86ed-873da66b5efa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:23.229327 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4b669777-d873-4c0c-9a19-a257e77eb9a5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:23.230185 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4b669777-d873-4c0c-9a19-a257e77eb9a5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:23.237893 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4b669777-d873-4c0c-9a19-a257e77eb9a5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:23.239007 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4b669777-d873-4c0c-9a19-a257e77eb9a5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:23.240477 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4b669777-d873-4c0c-9a19-a257e77eb9a5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:23.240912 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4b669777-d873-4c0c-9a19-a257e77eb9a5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:23.392869 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.objects.instance [None req-c87fe971-6fb2-4928-86ed-873da66b5efa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lazy-loading 'services' on Instance uuid 9301f1db-ecb0-465b-858c-64a2bfd4d5cb {{(pid=112577) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:45:23.457717 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4b669777-d873-4c0c-9a19-a257e77eb9a5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:23.466400 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4b669777-d873-4c0c-9a19-a257e77eb9a5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1259 microversion: 2.1 time: 0.241657 May 25 15:45:23.467005 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 371/719] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:23 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1259 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:23.535911 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c87fe971-6fb2-4928-86ed-873da66b5efa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/os-volume_attachments/aec917a3-6fe8-46b5-895a-ad640bed22d9" status: 202 len: 0 microversion: 2.20 time: 0.376092 May 25 15:45:23.536526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 349/720] 10.222.0.36 () {60 vars in 1457 bytes} [Tue May 25 15:45:23 2021] DELETE /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb/os-volume_attachments/aec917a3-6fe8-46b5-895a-ad640bed22d9 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:45:24.039219 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-587c7eba-4643-4b48-98d2-4d310906d8fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:24.040174 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-587c7eba-4643-4b48-98d2-4d310906d8fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:24.047390 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-587c7eba-4643-4b48-98d2-4d310906d8fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:24.047847 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-587c7eba-4643-4b48-98d2-4d310906d8fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:24.049152 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-587c7eba-4643-4b48-98d2-4d310906d8fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:24.049593 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-587c7eba-4643-4b48-98d2-4d310906d8fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:24.116440 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-587c7eba-4643-4b48-98d2-4d310906d8fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080800 May 25 15:45:24.116929 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 372/721] 10.222.0.36 () {58 vars in 1302 bytes} [Tue May 25 15:45:24 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:45:24.127824 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f51a8df8-0d87-40f6-a418-a7b728e8bca4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:24.128450 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f51a8df8-0d87-40f6-a418-a7b728e8bca4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:24.136275 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f51a8df8-0d87-40f6-a418-a7b728e8bca4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:24.136737 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f51a8df8-0d87-40f6-a418-a7b728e8bca4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:24.137774 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f51a8df8-0d87-40f6-a418-a7b728e8bca4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:24.138220 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f51a8df8-0d87-40f6-a418-a7b728e8bca4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:24.306253 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-f51a8df8-0d87-40f6-a418-a7b728e8bca4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] HTTP exception thrown: Instance 17e39efa-e568-41dd-9368-376ead8b1020 is not attached to volume 1aca56f5-465c-4ca6-9bc1-aa69b76f3bee May 25 15:45:24.306866 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f51a8df8-0d87-40f6-a418-a7b728e8bca4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Returning 404 to user: Instance 17e39efa-e568-41dd-9368-376ead8b1020 is not attached to volume 1aca56f5-465c-4ca6-9bc1-aa69b76f3bee {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:45:24.307708 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f51a8df8-0d87-40f6-a418-a7b728e8bca4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/os-volume_attachments/1aca56f5-465c-4ca6-9bc1-aa69b76f3bee" status: 404 len: 154 microversion: 2.1 time: 0.184895 May 25 15:45:24.308298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 350/722] 10.222.0.36 () {58 vars in 1416 bytes} [Tue May 25 15:45:24 2021] DELETE /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020/os-volume_attachments/1aca56f5-465c-4ca6-9bc1-aa69b76f3bee => generated 154 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:45:24.484222 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-90de1846-2157-4407-9f72-7f0994e9c5f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:24.485186 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-90de1846-2157-4407-9f72-7f0994e9c5f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:24.494244 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-90de1846-2157-4407-9f72-7f0994e9c5f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:24.494708 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-90de1846-2157-4407-9f72-7f0994e9c5f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:24.495502 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-90de1846-2157-4407-9f72-7f0994e9c5f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:24.495992 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-90de1846-2157-4407-9f72-7f0994e9c5f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:24.716454 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-90de1846-2157-4407-9f72-7f0994e9c5f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:24.726608 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-90de1846-2157-4407-9f72-7f0994e9c5f6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1259 microversion: 2.1 time: 0.246540 May 25 15:45:24.727347 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 373/723] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:24 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:24.746532 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:24.747039 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:24.755164 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:24.755636 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:24.756633 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:24.756998 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:24.825292 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Going to try to terminate instance {{(pid=112577) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:45:24.983381 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 204 len: 0 microversion: 2.20 time: 0.240061 May 25 15:45:24.984260 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 351/724] 10.222.0.36 () {60 vars in 1280 bytes} [Tue May 25 15:45:24 2021] DELETE /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 15:45:24.992833 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:24.993517 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:25.001535 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:25.002035 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:25.002835 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:25.003285 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:25.132786 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-b0e858ca-9a7c-47f8-90d8-c071f0d77e44 req-bebed4cd-adc5-4900-b5aa-bf43e95a9717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b8d3b0-aceb-4f56-a13d-7d0696f42901", "name": "network-vif-plugged", "status": "completed", "tag": "7ae06ec7-6469-494a-b223-ce3de0a0e2da"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:25.134624 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:45:25.134624 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:45:25.144400 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-b0e858ca-9a7c-47f8-90d8-c071f0d77e44 req-bebed4cd-adc5-4900-b5aa-bf43e95a9717 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:25.144852 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-b0e858ca-9a7c-47f8-90d8-c071f0d77e44 req-bebed4cd-adc5-4900-b5aa-bf43e95a9717 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:25.161721 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-b0e858ca-9a7c-47f8-90d8-c071f0d77e44 req-bebed4cd-adc5-4900-b5aa-bf43e95a9717 service nova] Creating event network-vif-plugged:7ae06ec7-6469-494a-b223-ce3de0a0e2da for instance a4b8d3b0-aceb-4f56-a13d-7d0696f42901 on hv-cinder-79123 May 25 15:45:25.166394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-b0e858ca-9a7c-47f8-90d8-c071f0d77e44 req-bebed4cd-adc5-4900-b5aa-bf43e95a9717 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037775 May 25 15:45:25.166987 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 352/725] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:45:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:45:25.214418 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:25.223390 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:25.224937 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:25.226086 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.237665 May 25 15:45:25.226654 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 374/726] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:24 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:45:25.544194 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a27b39cc-7211-4374-ba41-dfab9141b3cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:25.544795 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a27b39cc-7211-4374-ba41-dfab9141b3cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:25.552956 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a27b39cc-7211-4374-ba41-dfab9141b3cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:25.553418 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a27b39cc-7211-4374-ba41-dfab9141b3cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:25.554210 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a27b39cc-7211-4374-ba41-dfab9141b3cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:25.554655 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a27b39cc-7211-4374-ba41-dfab9141b3cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:25.614465 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a27b39cc-7211-4374-ba41-dfab9141b3cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Going to try to terminate instance {{(pid=112577) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:45:25.724436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a27b39cc-7211-4374-ba41-dfab9141b3cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 204 len: 0 microversion: 2.1 time: 0.184168 May 25 15:45:25.725009 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 353/727] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:45:25 2021] DELETE /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:45:25.733073 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-47f54488-6052-4455-8e3f-f72b752f6757 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:25.733988 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-47f54488-6052-4455-8e3f-f72b752f6757 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:25.742419 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-47f54488-6052-4455-8e3f-f72b752f6757 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:25.743108 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-47f54488-6052-4455-8e3f-f72b752f6757 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:25.744104 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-47f54488-6052-4455-8e3f-f72b752f6757 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:25.744550 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-47f54488-6052-4455-8e3f-f72b752f6757 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:25.744862 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f52ec04d-c74c-494b-997e-6f8cc84ac0ca tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:25.745564 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f52ec04d-c74c-494b-997e-6f8cc84ac0ca tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:25.753398 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f52ec04d-c74c-494b-997e-6f8cc84ac0ca tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:25.753847 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f52ec04d-c74c-494b-997e-6f8cc84ac0ca tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:25.754612 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f52ec04d-c74c-494b-997e-6f8cc84ac0ca tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:25.755047 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f52ec04d-c74c-494b-997e-6f8cc84ac0ca tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:25.955900 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f52ec04d-c74c-494b-997e-6f8cc84ac0ca tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:25.964437 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f52ec04d-c74c-494b-997e-6f8cc84ac0ca tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1259 microversion: 2.1 time: 0.223621 May 25 15:45:25.965019 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 354/728] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:25 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:45:25.976926 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-47f54488-6052-4455-8e3f-f72b752f6757 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:25.985487 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-47f54488-6052-4455-8e3f-f72b752f6757 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1555 microversion: 2.1 time: 0.256048 May 25 15:45:25.995659 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 375/729] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:25 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1555 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:26.243927 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:26.244553 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:26.251838 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:26.252330 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:26.253144 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:26.253596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:26.451980 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:26.461239 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:26.462747 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:26.463942 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.223720 May 25 15:45:26.464500 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 355/730] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:26 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:45:26.982030 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-57fe15bb-ca86-4b30-8317-241f87ab8589 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:26.982705 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-57fe15bb-ca86-4b30-8317-241f87ab8589 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:26.991021 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-57fe15bb-ca86-4b30-8317-241f87ab8589 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:26.991462 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-57fe15bb-ca86-4b30-8317-241f87ab8589 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:26.992270 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-57fe15bb-ca86-4b30-8317-241f87ab8589 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:26.992714 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-57fe15bb-ca86-4b30-8317-241f87ab8589 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:27.003740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b20f9092-0a37-45a8-8375-588281b5457d tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:27.004454 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b20f9092-0a37-45a8-8375-588281b5457d tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:27.012012 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b20f9092-0a37-45a8-8375-588281b5457d tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:27.012477 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b20f9092-0a37-45a8-8375-588281b5457d tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:27.013528 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b20f9092-0a37-45a8-8375-588281b5457d tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:27.013973 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b20f9092-0a37-45a8-8375-588281b5457d tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:27.195229 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-57fe15bb-ca86-4b30-8317-241f87ab8589 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:27.204007 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-57fe15bb-ca86-4b30-8317-241f87ab8589 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1444 microversion: 2.1 time: 0.225694 May 25 15:45:27.215096 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 376/731] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:26 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1444 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:45:27.219787 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9eeefb21-f0de-4db9-aac3-661613b18602 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:27.220611 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9eeefb21-f0de-4db9-aac3-661613b18602 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:27.228219 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9eeefb21-f0de-4db9-aac3-661613b18602 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:27.228673 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9eeefb21-f0de-4db9-aac3-661613b18602 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:27.229463 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9eeefb21-f0de-4db9-aac3-661613b18602 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:27.229898 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9eeefb21-f0de-4db9-aac3-661613b18602 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:27.311066 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b20f9092-0a37-45a8-8375-588281b5457d tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:27.319383 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b20f9092-0a37-45a8-8375-588281b5457d tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1555 microversion: 2.1 time: 0.320719 May 25 15:45:27.319967 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 356/732] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:26 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1555 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:45:27.422257 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9eeefb21-f0de-4db9-aac3-661613b18602 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:27.431422 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9eeefb21-f0de-4db9-aac3-661613b18602 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1444 microversion: 2.1 time: 0.215237 May 25 15:45:27.432035 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 377/733] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:27 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1444 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:27.482300 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9d753fcc-c48f-423a-8292-ff6b26add01a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:27.482912 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9d753fcc-c48f-423a-8292-ff6b26add01a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:27.491046 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d753fcc-c48f-423a-8292-ff6b26add01a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:27.491497 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d753fcc-c48f-423a-8292-ff6b26add01a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:27.492294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d753fcc-c48f-423a-8292-ff6b26add01a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:27.492728 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d753fcc-c48f-423a-8292-ff6b26add01a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:27.766889 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9d753fcc-c48f-423a-8292-ff6b26add01a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:27.777693 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9d753fcc-c48f-423a-8292-ff6b26add01a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:27.779709 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9d753fcc-c48f-423a-8292-ff6b26add01a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:27.781857 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9d753fcc-c48f-423a-8292-ff6b26add01a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1725 microversion: 2.20 time: 0.303293 May 25 15:45:27.782731 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 357/734] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:27 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1725 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:45:28.337089 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-35964a37-661b-4df5-8898-5098cc8a7225 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:28.337859 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-35964a37-661b-4df5-8898-5098cc8a7225 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:28.346932 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-35964a37-661b-4df5-8898-5098cc8a7225 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:28.352477 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-35964a37-661b-4df5-8898-5098cc8a7225 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:28.353542 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-35964a37-661b-4df5-8898-5098cc8a7225 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:28.354187 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-35964a37-661b-4df5-8898-5098cc8a7225 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:28.801355 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a3cc9e72-2f58-49fe-8d01-df6afe78d4c0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:28.801983 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a3cc9e72-2f58-49fe-8d01-df6afe78d4c0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:28.811822 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a3cc9e72-2f58-49fe-8d01-df6afe78d4c0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:28.811822 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a3cc9e72-2f58-49fe-8d01-df6afe78d4c0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:28.812132 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a3cc9e72-2f58-49fe-8d01-df6afe78d4c0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:28.812831 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a3cc9e72-2f58-49fe-8d01-df6afe78d4c0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:28.952068 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a3cc9e72-2f58-49fe-8d01-df6afe78d4c0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:28.961490 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a3cc9e72-2f58-49fe-8d01-df6afe78d4c0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:28.963269 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a3cc9e72-2f58-49fe-8d01-df6afe78d4c0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:28.964644 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a3cc9e72-2f58-49fe-8d01-df6afe78d4c0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1657 microversion: 2.20 time: 0.167767 May 25 15:45:28.965358 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 358/735] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:28 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1657 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:45:29.041513 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-35964a37-661b-4df5-8898-5098cc8a7225 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:29.051693 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-35964a37-661b-4df5-8898-5098cc8a7225 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1555 microversion: 2.1 time: 0.718522 May 25 15:45:29.052649 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 378/736] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:28 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1555 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:45:29.901944 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-bafeebcd-8eca-4037-9008-7eec7218436a req-cbbc1611-55cb-43e0-8573-d85f4b65c8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9301f1db-ecb0-465b-858c-64a2bfd4d5cb", "name": "network-vif-deleted", "tag": "3f734a1c-be04-4203-b351-6b0b6785f9ae"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:29.904897 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:45:29.904897 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:45:29.918488 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-bafeebcd-8eca-4037-9008-7eec7218436a req-cbbc1611-55cb-43e0-8573-d85f4b65c8c0 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:29.919456 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-bafeebcd-8eca-4037-9008-7eec7218436a req-cbbc1611-55cb-43e0-8573-d85f4b65c8c0 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:29.959672 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-bafeebcd-8eca-4037-9008-7eec7218436a req-cbbc1611-55cb-43e0-8573-d85f4b65c8c0 service nova] Creating event network-vif-deleted:3f734a1c-be04-4203-b351-6b0b6785f9ae for instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb on hv-cinder-79123 May 25 15:45:29.965161 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-bafeebcd-8eca-4037-9008-7eec7218436a req-cbbc1611-55cb-43e0-8573-d85f4b65c8c0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.448953 May 25 15:45:29.966517 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 359/737] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:45:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:45:29.983096 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:29.983733 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:30.000077 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:30.000562 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:30.003619 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:30.004112 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:30.071057 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9d0b6e92-63e9-490c-bcbf-aa8c78afdc6c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:30.072088 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9d0b6e92-63e9-490c-bcbf-aa8c78afdc6c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:30.089734 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d0b6e92-63e9-490c-bcbf-aa8c78afdc6c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:30.093549 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d0b6e92-63e9-490c-bcbf-aa8c78afdc6c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:30.108840 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d0b6e92-63e9-490c-bcbf-aa8c78afdc6c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:30.110230 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9d0b6e92-63e9-490c-bcbf-aa8c78afdc6c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:30.136275 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:30.136967 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:30.137479 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lazy-loading 'fault' on Instance uuid 9301f1db-ecb0-465b-858c-64a2bfd4d5cb {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:45:30.300568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:30.318784 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:30.324521 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:30.328937 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6ee57528-56ba-468d-ad43-0f839cc375e7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 200 len: 1372 microversion: 2.20 time: 0.348675 May 25 15:45:30.341529 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 379/738] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:29 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 1372 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:45:30.377877 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9d0b6e92-63e9-490c-bcbf-aa8c78afdc6c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a0b13957524c3d9fbf483e593a6137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:30.387235 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9d0b6e92-63e9-490c-bcbf-aa8c78afdc6c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 200 len: 1513 microversion: 2.1 time: 0.321236 May 25 15:45:30.388671 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 360/739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:30 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:31.360867 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-66bc54e6-572f-427e-aae4-cc1f4c26555c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:31.360867 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-66bc54e6-572f-427e-aae4-cc1f4c26555c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:31.361870 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-8724868f-bf95-4569-a6c3-dd45cbbc448c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b8d3b0-aceb-4f56-a13d-7d0696f42901", "tag": "7ae06ec7-6469-494a-b223-ce3de0a0e2da"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:31.363891 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:45:31.363891 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:45:31.379087 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-8724868f-bf95-4569-a6c3-dd45cbbc448c service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:31.379593 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-8724868f-bf95-4569-a6c3-dd45cbbc448c service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:31.382949 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-66bc54e6-572f-427e-aae4-cc1f4c26555c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:31.385076 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-66bc54e6-572f-427e-aae4-cc1f4c26555c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:31.388407 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-66bc54e6-572f-427e-aae4-cc1f4c26555c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:31.389109 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-66bc54e6-572f-427e-aae4-cc1f4c26555c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:31.418246 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-8724868f-bf95-4569-a6c3-dd45cbbc448c service nova] Creating event network-changed:7ae06ec7-6469-494a-b223-ce3de0a0e2da for instance a4b8d3b0-aceb-4f56-a13d-7d0696f42901 on hv-cinder-79123 May 25 15:45:31.437996 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-8724868f-bf95-4569-a6c3-dd45cbbc448c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083157 May 25 15:45:31.438949 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 361/740] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:45:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:45:31.446624 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2e865094-01e6-465b-af6d-011ce7a42c1e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:31.453320 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2e865094-01e6-465b-af6d-011ce7a42c1e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] [instance: 17e39efa-e568-41dd-9368-376ead8b1020] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:31.470391 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2e865094-01e6-465b-af6d-011ce7a42c1e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:31.472720 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2e865094-01e6-465b-af6d-011ce7a42c1e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:31.478301 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2e865094-01e6-465b-af6d-011ce7a42c1e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:31.479047 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2e865094-01e6-465b-af6d-011ce7a42c1e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:31.498565 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-66bc54e6-572f-427e-aae4-cc1f4c26555c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] HTTP exception thrown: Instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb could not be found. May 25 15:45:31.499196 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-66bc54e6-572f-427e-aae4-cc1f4c26555c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Returning 404 to user: Instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:45:31.500092 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-66bc54e6-572f-427e-aae4-cc1f4c26555c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 404 len: 111 microversion: 2.20 time: 0.155444 May 25 15:45:31.506417 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 380/741] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:31 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:45:31.515881 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7d40a80f-effd-4ac2-8104-44fe1584ecd4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '.version_select at 0x7f08859dc5e0>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:31.553590 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7d40a80f-effd-4ac2-8104-44fe1584ecd4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434779615" status: 204 len: 0 microversion: 2.20 time: 0.045785 May 25 15:45:31.554193 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 381/742] 10.222.0.36 () {60 vars in 1262 bytes} [Tue May 25 15:45:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434779615 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 15:45:31.588715 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-2e865094-01e6-465b-af6d-011ce7a42c1e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] HTTP exception thrown: Instance 17e39efa-e568-41dd-9368-376ead8b1020 could not be found. May 25 15:45:31.589618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2e865094-01e6-465b-af6d-011ce7a42c1e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Returning 404 to user: Instance 17e39efa-e568-41dd-9368-376ead8b1020 could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:45:31.590702 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2e865094-01e6-465b-af6d-011ce7a42c1e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020" status: 404 len: 111 microversion: 2.1 time: 0.150048 May 25 15:45:31.591520 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 362/743] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:31 2021] GET /compute/v2.1/servers/17e39efa-e568-41dd-9368-376ead8b1020 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:45:31.600077 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-59519144-6ad8-4ea0-aab9-1a199c2f0e60 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling method '.version_select at 0x7f0885984700>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:31.625178 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-59519144-6ad8-4ea0-aab9-1a199c2f0e60 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1344186687" status: 202 len: 0 microversion: 2.1 time: 0.028720 May 25 15:45:31.625846 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 382/744] 10.222.0.36 () {58 vars in 1272 bytes} [Tue May 25 15:45:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1344186687 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:45:31.989233 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-b0173f52-6b2f-491a-b633-e5fab6e23088 req-683fd741-f5d4-40e7-b597-473264d99f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e39efa-e568-41dd-9368-376ead8b1020", "name": "network-vif-deleted", "tag": "c536b9e5-ae17-4775-b209-71e6ec42122a"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:31.991002 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:45:31.991002 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:45:32.041774 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-b0173f52-6b2f-491a-b633-e5fab6e23088 req-683fd741-f5d4-40e7-b597-473264d99f61 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:32.042310 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-b0173f52-6b2f-491a-b633-e5fab6e23088 req-683fd741-f5d4-40e7-b597-473264d99f61 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:32.089754 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-b0173f52-6b2f-491a-b633-e5fab6e23088 req-683fd741-f5d4-40e7-b597-473264d99f61 service nova] Creating event network-vif-deleted:c536b9e5-ae17-4775-b209-71e6ec42122a for instance 17e39efa-e568-41dd-9368-376ead8b1020 on hv-cinder-79123 May 25 15:45:32.100316 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-b0173f52-6b2f-491a-b633-e5fab6e23088 req-683fd741-f5d4-40e7-b597-473264d99f61 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115100 May 25 15:45:32.101319 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 363/745] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:45:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:45:33.459219 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c126a126-3062-4cfb-8a7e-d36eff59dbf1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'create', calling method: .version_select at 0x7f08847c3ca0>, body: {"keypair": {"name": "tempest-keypair-2061766597"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:33.494765 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-c126a126-3062-4cfb-8a7e-d36eff59dbf1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Getting quotas for project c00f6cd8c3154d2f835d5f59da9cc7e3. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:45:33.499602 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-c126a126-3062-4cfb-8a7e-d36eff59dbf1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Getting quotas for user 4c8848f72ab74290b58ed881102d153e and project c00f6cd8c3154d2f835d5f59da9cc7e3. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:45:33.704259 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-c126a126-3062-4cfb-8a7e-d36eff59dbf1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Getting quotas for project c00f6cd8c3154d2f835d5f59da9cc7e3. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:45:33.708136 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-c126a126-3062-4cfb-8a7e-d36eff59dbf1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Getting quotas for user 4c8848f72ab74290b58ed881102d153e and project c00f6cd8c3154d2f835d5f59da9cc7e3. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:45:33.721266 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c126a126-3062-4cfb-8a7e-d36eff59dbf1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.268008 May 25 15:45:33.722173 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 383/746] 10.222.0.36 () {62 vars in 1199 bytes} [Tue May 25 15:45:33 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 269 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 25 15:45:35.597365 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-518694859", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76bea034-0890-4bf6-b793-280aaec1a32c"}], "security_groups": [{"name": "tempest-securitygroup--1831918636"}], "key_name": "tempest-keypair-2061766597", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:35.732065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] validate_networks() for [('76bea034-0890-4bf6-b793-280aaec1a32c', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:45:36.545669 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:45:36.546182 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:45:36.546742 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:45:36.547424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:45:36.547956 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:45:36.557439 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:36.557987 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:36.558884 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:36.559541 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:36.578125 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Getting quotas for project c00f6cd8c3154d2f835d5f59da9cc7e3. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:45:36.583131 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Getting quotas for user 4c8848f72ab74290b58ed881102d153e and project c00f6cd8c3154d2f835d5f59da9cc7e3. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:45:36.595180 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:45:36.598395 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:45:36.657288 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3648a329-fa04-4997-9ded-742dc8d7489a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.064908 May 25 15:45:36.670416 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7c7ee44d-53fe-4cb5-bd36-3dcd7eeac510 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:36.670785 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7c7ee44d-53fe-4cb5-bd36-3dcd7eeac510 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:36.675501 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 364/747] 10.222.0.36 () {62 vars in 1188 bytes} [Tue May 25 15:45:35 2021] POST /compute/v2.1/servers => generated 402 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 15:45:36.779700 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7c7ee44d-53fe-4cb5-bd36-3dcd7eeac510 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:36.788614 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7c7ee44d-53fe-4cb5-bd36-3dcd7eeac510 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:36.790149 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7c7ee44d-53fe-4cb5-bd36-3dcd7eeac510 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:36.791258 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7c7ee44d-53fe-4cb5-bd36-3dcd7eeac510 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1281 microversion: 2.20 time: 0.126550 May 25 15:45:36.799902 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 384/748] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:36 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1281 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:45:37.810658 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-27fdb7e5-5aff-44d5-bfc1-681f7bebd577 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:37.812493 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-27fdb7e5-5aff-44d5-bfc1-681f7bebd577 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:37.825063 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-27fdb7e5-5aff-44d5-bfc1-681f7bebd577 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:37.825552 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-27fdb7e5-5aff-44d5-bfc1-681f7bebd577 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:37.827334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-27fdb7e5-5aff-44d5-bfc1-681f7bebd577 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:37.827791 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-27fdb7e5-5aff-44d5-bfc1-681f7bebd577 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:38.009170 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-27fdb7e5-5aff-44d5-bfc1-681f7bebd577 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:38.034996 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-27fdb7e5-5aff-44d5-bfc1-681f7bebd577 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:38.040427 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-27fdb7e5-5aff-44d5-bfc1-681f7bebd577 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:38.049330 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-27fdb7e5-5aff-44d5-bfc1-681f7bebd577 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1341 microversion: 2.20 time: 0.243284 May 25 15:45:38.051835 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 365/749] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:37 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1341 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:45:39.069293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c7fc3586-7488-4d1f-a504-d9d294a0597b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:39.070502 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c7fc3586-7488-4d1f-a504-d9d294a0597b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:39.079137 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c7fc3586-7488-4d1f-a504-d9d294a0597b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:39.080256 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c7fc3586-7488-4d1f-a504-d9d294a0597b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:39.081079 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c7fc3586-7488-4d1f-a504-d9d294a0597b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:39.081532 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c7fc3586-7488-4d1f-a504-d9d294a0597b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:39.665984 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c7fc3586-7488-4d1f-a504-d9d294a0597b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:39.686418 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c7fc3586-7488-4d1f-a504-d9d294a0597b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:39.688135 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c7fc3586-7488-4d1f-a504-d9d294a0597b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:39.690100 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c7fc3586-7488-4d1f-a504-d9d294a0597b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1407 microversion: 2.20 time: 0.624726 May 25 15:45:39.701087 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 385/750] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:39 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1407 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:45:40.126386 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-bb68fe38-d406-4d5a-a83c-4b518e97b5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c657feea-6b2e-48ce-a311-464e6b956e0e", "tag": "8c3b5d16-b63c-438e-a031-8606d9e7796f"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:40.132238 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:45:40.132238 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:45:40.153225 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-bb68fe38-d406-4d5a-a83c-4b518e97b5d8 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:40.153665 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-bb68fe38-d406-4d5a-a83c-4b518e97b5d8 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:40.170793 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-bb68fe38-d406-4d5a-a83c-4b518e97b5d8 service nova] Creating event network-changed:8c3b5d16-b63c-438e-a031-8606d9e7796f for instance c657feea-6b2e-48ce-a311-464e6b956e0e on hv-cinder-79123 May 25 15:45:40.176571 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-bb68fe38-d406-4d5a-a83c-4b518e97b5d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059536 May 25 15:45:40.177362 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 366/751] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:45:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:45:40.708754 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-89920b39-8438-49e4-b459-e343271ad745 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:40.709496 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-89920b39-8438-49e4-b459-e343271ad745 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:40.719705 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-89920b39-8438-49e4-b459-e343271ad745 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:40.721052 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-89920b39-8438-49e4-b459-e343271ad745 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:40.721831 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-89920b39-8438-49e4-b459-e343271ad745 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:40.722278 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-89920b39-8438-49e4-b459-e343271ad745 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:41.142905 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-89920b39-8438-49e4-b459-e343271ad745 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:41.154620 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-89920b39-8438-49e4-b459-e343271ad745 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:41.156277 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-89920b39-8438-49e4-b459-e343271ad745 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:41.157376 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-89920b39-8438-49e4-b459-e343271ad745 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1407 microversion: 2.20 time: 0.452924 May 25 15:45:41.157940 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 386/752] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:40 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:45:42.175263 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:42.175901 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:42.184973 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:42.185547 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:42.186538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:42.187306 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:42.523364 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:42.532790 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:42.534904 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:42.536487 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1407 microversion: 2.20 time: 0.365402 May 25 15:45:42.547737 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 367/753] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:42 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:45:43.554811 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ed72a791-745b-45a1-857b-319bbb6359a4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:43.555357 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ed72a791-745b-45a1-857b-319bbb6359a4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:43.563404 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed72a791-745b-45a1-857b-319bbb6359a4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:43.563999 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed72a791-745b-45a1-857b-319bbb6359a4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:43.564800 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed72a791-745b-45a1-857b-319bbb6359a4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:43.565353 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed72a791-745b-45a1-857b-319bbb6359a4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:43.886390 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ed72a791-745b-45a1-857b-319bbb6359a4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:43.896588 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ed72a791-745b-45a1-857b-319bbb6359a4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:43.898259 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ed72a791-745b-45a1-857b-319bbb6359a4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:43.899474 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ed72a791-745b-45a1-857b-319bbb6359a4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1407 microversion: 2.20 time: 0.348559 May 25 15:45:43.900172 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 387/754] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:43 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:45:44.917184 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5b523f54-9ef1-4cee-8f61-bc107a706216 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:44.917838 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5b523f54-9ef1-4cee-8f61-bc107a706216 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:44.925078 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5b523f54-9ef1-4cee-8f61-bc107a706216 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:44.925551 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5b523f54-9ef1-4cee-8f61-bc107a706216 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:44.926337 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5b523f54-9ef1-4cee-8f61-bc107a706216 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:44.926791 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5b523f54-9ef1-4cee-8f61-bc107a706216 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:45.141228 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5b523f54-9ef1-4cee-8f61-bc107a706216 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:45.152070 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5b523f54-9ef1-4cee-8f61-bc107a706216 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:45.153586 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5b523f54-9ef1-4cee-8f61-bc107a706216 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:45.154925 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5b523f54-9ef1-4cee-8f61-bc107a706216 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1407 microversion: 2.20 time: 0.241502 May 25 15:45:45.155898 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 368/755] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:44 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:45:45.419673 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-25821866-b7d3-48cb-9591-dc91433c28ae req-0737eb81-ae57-4006-bd4e-589e05c7bacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c657feea-6b2e-48ce-a311-464e6b956e0e", "name": "network-vif-plugged", "status": "completed", "tag": "8c3b5d16-b63c-438e-a031-8606d9e7796f"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:45.422630 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:45:45.422630 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:45:45.431524 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-25821866-b7d3-48cb-9591-dc91433c28ae req-0737eb81-ae57-4006-bd4e-589e05c7bacd service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:45.432008 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-25821866-b7d3-48cb-9591-dc91433c28ae req-0737eb81-ae57-4006-bd4e-589e05c7bacd service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:45.453009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-25821866-b7d3-48cb-9591-dc91433c28ae req-0737eb81-ae57-4006-bd4e-589e05c7bacd service nova] Creating event network-vif-plugged:8c3b5d16-b63c-438e-a031-8606d9e7796f for instance c657feea-6b2e-48ce-a311-464e6b956e0e on hv-cinder-79123 May 25 15:45:45.460673 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-25821866-b7d3-48cb-9591-dc91433c28ae req-0737eb81-ae57-4006-bd4e-589e05c7bacd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261071 May 25 15:45:45.460673 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 388/756] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:45:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:45:46.172770 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:46.173955 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:46.181398 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:46.181931 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:46.182666 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:46.183122 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:46.404259 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:46.415576 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:46.417074 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:46.418178 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1407 microversion: 2.20 time: 0.249119 May 25 15:45:46.418747 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 369/757] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:46 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:45:47.436334 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:47.437037 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:47.445252 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:47.445731 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:47.446535 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:47.447013 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:47.642154 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:47.651416 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:47.652957 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:47.654100 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1598 microversion: 2.20 time: 0.221974 May 25 15:45:47.654651 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 389/758] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:45:47 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1598 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:45:47.671399 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a7614391-98ec-40c4-b149-a206ef23cc36 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:47.671924 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a7614391-98ec-40c4-b149-a206ef23cc36 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:47.679796 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a7614391-98ec-40c4-b149-a206ef23cc36 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:47.680291 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a7614391-98ec-40c4-b149-a206ef23cc36 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:47.681176 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a7614391-98ec-40c4-b149-a206ef23cc36 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:47.681626 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a7614391-98ec-40c4-b149-a206ef23cc36 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:47.826446 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a7614391-98ec-40c4-b149-a206ef23cc36 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.158682 May 25 15:45:47.827084 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 370/759] 10.222.0.36 () {60 vars in 1316 bytes} [Tue May 25 15:45:47 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:45:49.022921 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:49.023509 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:49.030796 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:49.031360 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:49.032261 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:49.033366 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:49.097740 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Going to try to terminate instance {{(pid=112576) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:45:49.220269 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 204 len: 0 microversion: 2.1 time: 0.200614 May 25 15:45:49.221071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 390/760] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:45:49 2021] DELETE /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:45:49.229006 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-51dfa728-6a54-4b45-b403-94ac226d103e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:49.230450 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-51dfa728-6a54-4b45-b403-94ac226d103e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:49.237003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-51dfa728-6a54-4b45-b403-94ac226d103e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:49.237467 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-51dfa728-6a54-4b45-b403-94ac226d103e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:49.238232 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-51dfa728-6a54-4b45-b403-94ac226d103e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:49.238669 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-51dfa728-6a54-4b45-b403-94ac226d103e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:49.420276 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-52b7b4f6-84d6-4cc7-a3a6-dbe78654c977 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:49.421440 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-52b7b4f6-84d6-4cc7-a3a6-dbe78654c977 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:49.429761 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-52b7b4f6-84d6-4cc7-a3a6-dbe78654c977 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:49.430452 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-52b7b4f6-84d6-4cc7-a3a6-dbe78654c977 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:49.431307 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-52b7b4f6-84d6-4cc7-a3a6-dbe78654c977 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:49.431815 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-52b7b4f6-84d6-4cc7-a3a6-dbe78654c977 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:49.455302 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-51dfa728-6a54-4b45-b403-94ac226d103e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:49.463834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-51dfa728-6a54-4b45-b403-94ac226d103e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1672 microversion: 2.1 time: 0.238548 May 25 15:45:49.464491 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 371/761] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:49 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1672 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:49.472921 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-07474d7d-6e1c-43c0-8114-25ae119ec2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c657feea-6b2e-48ce-a311-464e6b956e0e", "tag": "8c3b5d16-b63c-438e-a031-8606d9e7796f"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:49.474692 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:45:49.474692 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:45:49.483214 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-07474d7d-6e1c-43c0-8114-25ae119ec2f0 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:49.483908 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-07474d7d-6e1c-43c0-8114-25ae119ec2f0 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:49.503603 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-07474d7d-6e1c-43c0-8114-25ae119ec2f0 service nova] Creating event network-changed:8c3b5d16-b63c-438e-a031-8606d9e7796f for instance c657feea-6b2e-48ce-a311-464e6b956e0e on hv-cinder-79123 May 25 15:45:49.509689 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-07474d7d-6e1c-43c0-8114-25ae119ec2f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043497 May 25 15:45:49.510297 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 372/762] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:45:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:45:49.602553 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-52b7b4f6-84d6-4cc7-a3a6-dbe78654c977 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 14 microversion: 2.20 time: 0.186419 May 25 15:45:49.605875 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 391/763] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:45:49 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:45:50.482594 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-27c8cb68-7062-42af-b57d-02c4a632e04e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:50.483374 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-27c8cb68-7062-42af-b57d-02c4a632e04e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:50.491346 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-27c8cb68-7062-42af-b57d-02c4a632e04e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:50.491807 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-27c8cb68-7062-42af-b57d-02c4a632e04e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:50.492657 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-27c8cb68-7062-42af-b57d-02c4a632e04e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:50.493103 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-27c8cb68-7062-42af-b57d-02c4a632e04e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:50.614905 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1519375f-3504-4d7f-9f6c-610cbc1a9e5f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:50.616273 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1519375f-3504-4d7f-9f6c-610cbc1a9e5f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:50.624976 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1519375f-3504-4d7f-9f6c-610cbc1a9e5f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:50.625591 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1519375f-3504-4d7f-9f6c-610cbc1a9e5f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:50.627008 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1519375f-3504-4d7f-9f6c-610cbc1a9e5f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:50.627594 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1519375f-3504-4d7f-9f6c-610cbc1a9e5f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:50.707000 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-27c8cb68-7062-42af-b57d-02c4a632e04e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:50.715596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-27c8cb68-7062-42af-b57d-02c4a632e04e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1672 microversion: 2.1 time: 0.237311 May 25 15:45:50.716290 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 373/764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:50 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1672 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:50.743950 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1519375f-3504-4d7f-9f6c-610cbc1a9e5f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 14 microversion: 2.20 time: 0.133730 May 25 15:45:50.744701 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 392/765] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:45:50 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:45:51.733614 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-20163dbe-3fe2-4cc8-91d8-789ffd90612b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:51.734243 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-20163dbe-3fe2-4cc8-91d8-789ffd90612b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:51.742626 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-20163dbe-3fe2-4cc8-91d8-789ffd90612b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:51.743119 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-20163dbe-3fe2-4cc8-91d8-789ffd90612b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:51.743962 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-20163dbe-3fe2-4cc8-91d8-789ffd90612b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:51.744412 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-20163dbe-3fe2-4cc8-91d8-789ffd90612b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:51.756243 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e862d38a-d044-4928-b36b-121481c320d4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:51.757574 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e862d38a-d044-4928-b36b-121481c320d4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:51.765884 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e862d38a-d044-4928-b36b-121481c320d4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:51.766476 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e862d38a-d044-4928-b36b-121481c320d4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:51.767415 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e862d38a-d044-4928-b36b-121481c320d4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:51.768002 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e862d38a-d044-4928-b36b-121481c320d4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:51.877223 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e862d38a-d044-4928-b36b-121481c320d4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 14 microversion: 2.20 time: 0.124900 May 25 15:45:51.880810 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 393/766] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:45:51 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:45:52.243233 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-20163dbe-3fe2-4cc8-91d8-789ffd90612b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:52.251500 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-20163dbe-3fe2-4cc8-91d8-789ffd90612b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1672 microversion: 2.1 time: 0.522313 May 25 15:45:52.252179 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 374/767] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:51 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1672 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:52.889857 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-96d9a178-44fc-4262-ae20-54d909e5bd44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:52.892836 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-96d9a178-44fc-4262-ae20-54d909e5bd44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:52.907358 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-96d9a178-44fc-4262-ae20-54d909e5bd44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:52.908177 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-96d9a178-44fc-4262-ae20-54d909e5bd44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:52.909396 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-96d9a178-44fc-4262-ae20-54d909e5bd44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:52.910098 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-96d9a178-44fc-4262-ae20-54d909e5bd44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:52.989249 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-7237228d-f9c3-4320-b1a0-61313db52b98 req-6d4250eb-e8cc-445e-a1aa-2d89a64cd23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92aed9d5-56b6-4cbf-9678-b16f7de68b23", "name": "network-vif-deleted", "tag": "cfbb7459-c8f7-4441-8886-be2a6b4ad1a7"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:52.991535 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:45:52.991535 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:45:53.002309 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-7237228d-f9c3-4320-b1a0-61313db52b98 req-6d4250eb-e8cc-445e-a1aa-2d89a64cd23e service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:53.002875 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-7237228d-f9c3-4320-b1a0-61313db52b98 req-6d4250eb-e8cc-445e-a1aa-2d89a64cd23e service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:53.022836 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-7237228d-f9c3-4320-b1a0-61313db52b98 req-6d4250eb-e8cc-445e-a1aa-2d89a64cd23e service nova] Creating event network-vif-deleted:cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 for instance 92aed9d5-56b6-4cbf-9678-b16f7de68b23 on hv-cinder-79123 May 25 15:45:53.027688 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-7237228d-f9c3-4320-b1a0-61313db52b98 req-6d4250eb-e8cc-445e-a1aa-2d89a64cd23e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042308 May 25 15:45:53.028680 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 375/768] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:45:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:45:53.044976 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-96d9a178-44fc-4262-ae20-54d909e5bd44 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 14 microversion: 2.20 time: 0.159331 May 25 15:45:53.045751 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 394/769] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:45:52 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:45:53.269567 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:53.270312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:53.277725 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:53.278184 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:53.278963 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:53.279407 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:53.346736 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:53.347192 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:53.347651 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.objects.instance [None req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lazy-loading 'fault' on Instance uuid 92aed9d5-56b6-4cbf-9678-b16f7de68b23 {{(pid=112577) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:45:53.422854 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:53.431888 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 200 len: 1325 microversion: 2.1 time: 0.166506 May 25 15:45:53.432557 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 376/770] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:53 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 1325 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:45:54.057007 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d1354b4b-75e6-4e1f-8a0b-ec2111933a21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:54.058060 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d1354b4b-75e6-4e1f-8a0b-ec2111933a21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:54.066130 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d1354b4b-75e6-4e1f-8a0b-ec2111933a21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:54.066593 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d1354b4b-75e6-4e1f-8a0b-ec2111933a21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:54.067405 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d1354b4b-75e6-4e1f-8a0b-ec2111933a21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:54.067851 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d1354b4b-75e6-4e1f-8a0b-ec2111933a21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:54.178265 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d1354b4b-75e6-4e1f-8a0b-ec2111933a21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 14 microversion: 2.20 time: 0.125424 May 25 15:45:54.178997 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 395/771] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:45:54 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:54.449337 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-86854013-d815-4974-a840-7137fd1de048 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:54.449969 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-86854013-d815-4974-a840-7137fd1de048 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:54.458204 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-86854013-d815-4974-a840-7137fd1de048 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:54.458701 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-86854013-d815-4974-a840-7137fd1de048 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:54.459506 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-86854013-d815-4974-a840-7137fd1de048 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:54.460030 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-86854013-d815-4974-a840-7137fd1de048 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:54.511412 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-86854013-d815-4974-a840-7137fd1de048 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] HTTP exception thrown: Instance 92aed9d5-56b6-4cbf-9678-b16f7de68b23 could not be found. May 25 15:45:54.512059 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-86854013-d815-4974-a840-7137fd1de048 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Returning 404 to user: Instance 92aed9d5-56b6-4cbf-9678-b16f7de68b23 could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:45:54.513154 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-86854013-d815-4974-a840-7137fd1de048 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 404 len: 111 microversion: 2.1 time: 0.067549 May 25 15:45:54.513698 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 377/772] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:54 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:45:54.523064 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-36b05ea2-2c5d-439e-9c65-fba8f892fce7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '.version_select at 0x7f08859dcca0>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:54.539806 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-36b05ea2-2c5d-439e-9c65-fba8f892fce7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-122935831" status: 202 len: 0 microversion: 2.1 time: 0.020917 May 25 15:45:54.540390 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 396/773] 10.222.0.36 () {58 vars in 1218 bytes} [Tue May 25 15:45:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-122935831 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:45:55.189394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a6dc2211-02c1-44f8-83fb-e7a887a57ab0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:55.190326 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a6dc2211-02c1-44f8-83fb-e7a887a57ab0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:55.197600 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a6dc2211-02c1-44f8-83fb-e7a887a57ab0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:55.198062 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a6dc2211-02c1-44f8-83fb-e7a887a57ab0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:55.198839 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a6dc2211-02c1-44f8-83fb-e7a887a57ab0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:55.199314 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a6dc2211-02c1-44f8-83fb-e7a887a57ab0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:55.310994 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a6dc2211-02c1-44f8-83fb-e7a887a57ab0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 14 microversion: 2.20 time: 0.125264 May 25 15:45:55.311648 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 378/774] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:45:55 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:45:55.620883 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e758e2bf-df77-4469-a01d-9e01a98d0c20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'create', calling method: .version_select at 0x7f08850e7550>, body: {"keypair": {"name": "tempest-keypair-1517409382"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:55.644024 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-e758e2bf-df77-4469-a01d-9e01a98d0c20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Getting quotas for project 42ea914db4fc4438a1d50bfff262a6e8. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:45:55.648054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-e758e2bf-df77-4469-a01d-9e01a98d0c20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Getting quotas for user ff91a3b3f9f64b2f8ed2cc67943c1d6e and project 42ea914db4fc4438a1d50bfff262a6e8. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:45:56.266598 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-e758e2bf-df77-4469-a01d-9e01a98d0c20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Getting quotas for project 42ea914db4fc4438a1d50bfff262a6e8. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:45:56.270444 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-e758e2bf-df77-4469-a01d-9e01a98d0c20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Getting quotas for user ff91a3b3f9f64b2f8ed2cc67943c1d6e and project 42ea914db4fc4438a1d50bfff262a6e8. Resources: {'key_pairs'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:45:56.283609 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e758e2bf-df77-4469-a01d-9e01a98d0c20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.667225 May 25 15:45:56.284523 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 397/775] 10.222.0.36 () {60 vars in 1158 bytes} [Tue May 25 15:45:55 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:56.322004 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-bee1e76b-65db-47fc-8c88-f13c9838b59a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:56.323118 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-bee1e76b-65db-47fc-8c88-f13c9838b59a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:56.331827 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bee1e76b-65db-47fc-8c88-f13c9838b59a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:56.332326 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bee1e76b-65db-47fc-8c88-f13c9838b59a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:56.333115 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bee1e76b-65db-47fc-8c88-f13c9838b59a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:56.333558 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bee1e76b-65db-47fc-8c88-f13c9838b59a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:56.441029 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-bee1e76b-65db-47fc-8c88-f13c9838b59a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 14 microversion: 2.20 time: 0.123036 May 25 15:45:56.444181 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 379/776] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:45:56 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:57.452704 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-64b838d3-98a2-427c-9860-826e07ffc94a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:57.453868 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-64b838d3-98a2-427c-9860-826e07ffc94a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:57.464606 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-64b838d3-98a2-427c-9860-826e07ffc94a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:57.465385 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-64b838d3-98a2-427c-9860-826e07ffc94a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:57.466426 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-64b838d3-98a2-427c-9860-826e07ffc94a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:57.467108 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-64b838d3-98a2-427c-9860-826e07ffc94a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:57.577233 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-64b838d3-98a2-427c-9860-826e07ffc94a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 14 microversion: 2.20 time: 0.128773 May 25 15:45:57.581440 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 398/777] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:45:57 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:57.910042 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-236055152", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "320ad3f5-0f83-444c-8df0-70303c7a4446"}], "security_groups": [{"name": "tempest-securitygroup--1222461500"}], "key_name": "tempest-keypair-1517409382", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:58.119087 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] validate_networks() for [('320ad3f5-0f83-444c-8df0-70303c7a4446', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:45:58.591183 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-cfcd4dda-18a3-4576-b30f-1e54433f4fe1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:58.592009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-cfcd4dda-18a3-4576-b30f-1e54433f4fe1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:58.601023 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cfcd4dda-18a3-4576-b30f-1e54433f4fe1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:58.601624 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cfcd4dda-18a3-4576-b30f-1e54433f4fe1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:58.602410 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cfcd4dda-18a3-4576-b30f-1e54433f4fe1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:58.602850 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cfcd4dda-18a3-4576-b30f-1e54433f4fe1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:58.663188 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:45:58.663736 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:45:58.664382 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:45:58.664908 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:45:58.665547 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:45:58.675529 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:58.676116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:58.677007 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:58.677526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:58.696284 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Getting quotas for project 42ea914db4fc4438a1d50bfff262a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:45:58.700414 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Getting quotas for user ff91a3b3f9f64b2f8ed2cc67943c1d6e and project 42ea914db4fc4438a1d50bfff262a6e8. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:45:58.711705 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-cfcd4dda-18a3-4576-b30f-1e54433f4fe1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 14 microversion: 2.20 time: 0.126184 May 25 15:45:58.712376 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 399/778] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:45:58 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:45:58.712578 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:45:58.715223 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:45:58.760585 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b8f6ce78-17d5-4de7-bec3-ca221845832b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.854986 May 25 15:45:58.761347 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 380/779] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:45:57 2021] POST /compute/v2.1/servers => generated 402 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:45:58.773429 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f4db790f-e307-4fbb-b3da-0f8d8d95e936 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:58.774359 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f4db790f-e307-4fbb-b3da-0f8d8d95e936 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:58.870911 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f4db790f-e307-4fbb-b3da-0f8d8d95e936 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:45:58.895420 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f4db790f-e307-4fbb-b3da-0f8d8d95e936 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1237 microversion: 2.1 time: 0.126695 May 25 15:45:58.895992 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 400/780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:58 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1237 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:45:59.722880 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1b6bcb91-6fd8-4073-a872-cc8abf3da644 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:45:59.723782 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1b6bcb91-6fd8-4073-a872-cc8abf3da644 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:59.734543 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1b6bcb91-6fd8-4073-a872-cc8abf3da644 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:59.735007 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1b6bcb91-6fd8-4073-a872-cc8abf3da644 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:59.736400 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1b6bcb91-6fd8-4073-a872-cc8abf3da644 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:59.736846 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1b6bcb91-6fd8-4073-a872-cc8abf3da644 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:59.912643 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4cfdd75a-edd9-4293-9388-160979b84520 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:45:59.913296 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4cfdd75a-edd9-4293-9388-160979b84520 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:45:59.921956 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cfdd75a-edd9-4293-9388-160979b84520 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:59.922407 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cfdd75a-edd9-4293-9388-160979b84520 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:59.923182 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cfdd75a-edd9-4293-9388-160979b84520 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:59.923673 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cfdd75a-edd9-4293-9388-160979b84520 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:00.048055 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4cfdd75a-edd9-4293-9388-160979b84520 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:00.056163 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4cfdd75a-edd9-4293-9388-160979b84520 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1233 microversion: 2.1 time: 0.147207 May 25 15:46:00.056720 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 401/781] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:45:59 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1233 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:01.072797 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-046b2aa1-76ed-4fa6-b611-2ecbbd2b1a1f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:01.073377 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-046b2aa1-76ed-4fa6-b611-2ecbbd2b1a1f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:01.080629 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-046b2aa1-76ed-4fa6-b611-2ecbbd2b1a1f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:01.081081 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-046b2aa1-76ed-4fa6-b611-2ecbbd2b1a1f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:01.081855 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-046b2aa1-76ed-4fa6-b611-2ecbbd2b1a1f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:01.082296 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-046b2aa1-76ed-4fa6-b611-2ecbbd2b1a1f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:01.198632 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-046b2aa1-76ed-4fa6-b611-2ecbbd2b1a1f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:01.206722 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-046b2aa1-76ed-4fa6-b611-2ecbbd2b1a1f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1233 microversion: 2.1 time: 0.137665 May 25 15:46:01.207287 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 402/782] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:01 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1233 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:02.223022 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6a0ca5b2-17e8-4dbe-9efb-274a77102a3e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:02.223641 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6a0ca5b2-17e8-4dbe-9efb-274a77102a3e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:02.231342 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6a0ca5b2-17e8-4dbe-9efb-274a77102a3e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:02.231797 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6a0ca5b2-17e8-4dbe-9efb-274a77102a3e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:02.232604 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6a0ca5b2-17e8-4dbe-9efb-274a77102a3e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:02.233046 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6a0ca5b2-17e8-4dbe-9efb-274a77102a3e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:02.328499 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1b6bcb91-6fd8-4073-a872-cc8abf3da644 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 14 microversion: 2.20 time: 2.610163 May 25 15:46:02.332693 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 381/783] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:45:59 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 14 bytes in 2615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:02.495743 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6a0ca5b2-17e8-4dbe-9efb-274a77102a3e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:02.505787 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6a0ca5b2-17e8-4dbe-9efb-274a77102a3e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1289 microversion: 2.1 time: 0.287115 May 25 15:46:02.506359 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 403/784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:02 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1289 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:03.340985 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e8a1dcf3-ef30-46e0-bf99-52de1b4beed1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:03.342067 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e8a1dcf3-ef30-46e0-bf99-52de1b4beed1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:03.350366 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e8a1dcf3-ef30-46e0-bf99-52de1b4beed1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:03.350833 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e8a1dcf3-ef30-46e0-bf99-52de1b4beed1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:03.351620 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e8a1dcf3-ef30-46e0-bf99-52de1b4beed1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:03.352104 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e8a1dcf3-ef30-46e0-bf99-52de1b4beed1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:03.464350 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e8a1dcf3-ef30-46e0-bf99-52de1b4beed1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 14 microversion: 2.20 time: 0.127461 May 25 15:46:03.465144 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 382/785] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:03 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:03.522482 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-aede9fa0-c342-4695-bb00-2a5b793817a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:03.523264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-aede9fa0-c342-4695-bb00-2a5b793817a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:03.530732 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aede9fa0-c342-4695-bb00-2a5b793817a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:03.531277 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aede9fa0-c342-4695-bb00-2a5b793817a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:03.532196 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aede9fa0-c342-4695-bb00-2a5b793817a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:03.532719 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aede9fa0-c342-4695-bb00-2a5b793817a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:03.649875 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-aede9fa0-c342-4695-bb00-2a5b793817a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:03.658324 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-aede9fa0-c342-4695-bb00-2a5b793817a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1295 microversion: 2.1 time: 0.139514 May 25 15:46:03.658898 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 404/786] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:03 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1295 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:04.477565 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-da9e8c7d-f599-4eee-a061-2d05ff8288c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:04.479219 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-da9e8c7d-f599-4eee-a061-2d05ff8288c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:04.488525 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-da9e8c7d-f599-4eee-a061-2d05ff8288c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:04.489113 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-da9e8c7d-f599-4eee-a061-2d05ff8288c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:04.490000 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-da9e8c7d-f599-4eee-a061-2d05ff8288c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:04.490593 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-da9e8c7d-f599-4eee-a061-2d05ff8288c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:04.609788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-da9e8c7d-f599-4eee-a061-2d05ff8288c1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 14 microversion: 2.20 time: 0.136552 May 25 15:46:04.610642 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 383/787] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:04 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:04.674573 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-97b78039-f145-47a7-8bd1-0671867c37a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:04.675777 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-97b78039-f145-47a7-8bd1-0671867c37a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:04.685194 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-97b78039-f145-47a7-8bd1-0671867c37a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:04.686079 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-97b78039-f145-47a7-8bd1-0671867c37a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:04.687050 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-97b78039-f145-47a7-8bd1-0671867c37a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:04.687667 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-97b78039-f145-47a7-8bd1-0671867c37a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:04.908399 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-97b78039-f145-47a7-8bd1-0671867c37a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:04.917212 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-97b78039-f145-47a7-8bd1-0671867c37a9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1363 microversion: 2.1 time: 0.246383 May 25 15:46:04.925785 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 405/788] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:04 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:04.929193 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-dc4f7a31-dd83-4d28-a484-44d7688545b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b093877-20ab-4678-8d94-a89983bda325", "tag": "a7d32eab-b1e5-4dcd-bb06-5f06e6841586"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:04.932911 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:46:04.932911 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:46:04.945585 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-dc4f7a31-dd83-4d28-a484-44d7688545b7 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:04.946047 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-dc4f7a31-dd83-4d28-a484-44d7688545b7 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:04.968411 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-dc4f7a31-dd83-4d28-a484-44d7688545b7 service nova] Creating event network-changed:a7d32eab-b1e5-4dcd-bb06-5f06e6841586 for instance 4b093877-20ab-4678-8d94-a89983bda325 on hv-cinder-79123 May 25 15:46:04.976546 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-dc4f7a31-dd83-4d28-a484-44d7688545b7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054906 May 25 15:46:04.977227 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 384/789] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:46:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:46:05.620725 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e71d7cf2-39e0-4ae3-91e0-94fbd2440c34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:05.621758 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e71d7cf2-39e0-4ae3-91e0-94fbd2440c34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:05.629113 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e71d7cf2-39e0-4ae3-91e0-94fbd2440c34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:05.629577 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e71d7cf2-39e0-4ae3-91e0-94fbd2440c34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:05.630399 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e71d7cf2-39e0-4ae3-91e0-94fbd2440c34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:05.630854 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e71d7cf2-39e0-4ae3-91e0-94fbd2440c34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:05.744930 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e71d7cf2-39e0-4ae3-91e0-94fbd2440c34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 10009 microversion: 2.20 time: 0.128176 May 25 15:46:05.745572 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 406/790] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:05 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 10009 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:05.936002 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-47dfa9af-48ff-4dd5-994d-3861a1b0038d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:05.936931 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-47dfa9af-48ff-4dd5-994d-3861a1b0038d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:05.945494 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-47dfa9af-48ff-4dd5-994d-3861a1b0038d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:05.945954 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-47dfa9af-48ff-4dd5-994d-3861a1b0038d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:05.946746 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-47dfa9af-48ff-4dd5-994d-3861a1b0038d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:05.947193 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-47dfa9af-48ff-4dd5-994d-3861a1b0038d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:06.380637 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-47dfa9af-48ff-4dd5-994d-3861a1b0038d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:06.389452 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-47dfa9af-48ff-4dd5-994d-3861a1b0038d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1363 microversion: 2.1 time: 0.458345 May 25 15:46:06.390026 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 385/791] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:05 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1363 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:06.757436 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-21cd9118-0b75-4351-b74f-af5990f7ca72 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:06.758458 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-21cd9118-0b75-4351-b74f-af5990f7ca72 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:06.766600 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-21cd9118-0b75-4351-b74f-af5990f7ca72 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:06.767064 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-21cd9118-0b75-4351-b74f-af5990f7ca72 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:06.767875 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-21cd9118-0b75-4351-b74f-af5990f7ca72 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:06.768325 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-21cd9118-0b75-4351-b74f-af5990f7ca72 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:06.875646 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-21cd9118-0b75-4351-b74f-af5990f7ca72 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 15025 microversion: 2.20 time: 0.122229 May 25 15:46:06.876436 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 407/792] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:06 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 15025 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:07.406737 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-08e9eb96-5477-443a-8cd8-ffaa07a6b1ef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:07.407920 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-08e9eb96-5477-443a-8cd8-ffaa07a6b1ef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:07.416184 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-08e9eb96-5477-443a-8cd8-ffaa07a6b1ef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:07.416730 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-08e9eb96-5477-443a-8cd8-ffaa07a6b1ef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:07.417510 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-08e9eb96-5477-443a-8cd8-ffaa07a6b1ef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:07.417967 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-08e9eb96-5477-443a-8cd8-ffaa07a6b1ef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:07.616888 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-08e9eb96-5477-443a-8cd8-ffaa07a6b1ef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:07.625362 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-08e9eb96-5477-443a-8cd8-ffaa07a6b1ef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1363 microversion: 2.1 time: 0.222500 May 25 15:46:07.625932 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 386/793] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:07 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:07.886861 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0f01964f-a45c-43d3-92cf-c17987fc678e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:07.887801 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0f01964f-a45c-43d3-92cf-c17987fc678e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:07.896599 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0f01964f-a45c-43d3-92cf-c17987fc678e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:07.897069 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0f01964f-a45c-43d3-92cf-c17987fc678e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:07.897850 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0f01964f-a45c-43d3-92cf-c17987fc678e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:07.898295 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0f01964f-a45c-43d3-92cf-c17987fc678e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:08.006687 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0f01964f-a45c-43d3-92cf-c17987fc678e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 18102 microversion: 2.20 time: 0.123948 May 25 15:46:08.007299 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 408/794] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:07 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 18102 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:08.645790 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-441d16bc-7a2f-4934-b3d0-31b0ab48c7cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:08.646417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-441d16bc-7a2f-4934-b3d0-31b0ab48c7cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:08.654156 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-441d16bc-7a2f-4934-b3d0-31b0ab48c7cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:08.654621 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-441d16bc-7a2f-4934-b3d0-31b0ab48c7cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:08.655413 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-441d16bc-7a2f-4934-b3d0-31b0ab48c7cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:08.655876 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-441d16bc-7a2f-4934-b3d0-31b0ab48c7cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:08.900618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-441d16bc-7a2f-4934-b3d0-31b0ab48c7cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:08.909576 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-441d16bc-7a2f-4934-b3d0-31b0ab48c7cd tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1363 microversion: 2.1 time: 0.267964 May 25 15:46:08.910271 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 387/795] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:08 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:09.019738 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2f04e728-3ce8-42ed-b6ae-d1bce6e30c1f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:09.020736 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2f04e728-3ce8-42ed-b6ae-d1bce6e30c1f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:09.029230 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f04e728-3ce8-42ed-b6ae-d1bce6e30c1f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:09.029918 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f04e728-3ce8-42ed-b6ae-d1bce6e30c1f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:09.030715 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f04e728-3ce8-42ed-b6ae-d1bce6e30c1f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:09.031308 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f04e728-3ce8-42ed-b6ae-d1bce6e30c1f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:09.136630 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2f04e728-3ce8-42ed-b6ae-d1bce6e30c1f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 18498 microversion: 2.20 time: 0.121402 May 25 15:46:09.138611 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 409/796] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:09 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 18498 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:09.363237 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-7399abe7-e0d2-4f00-a765-69329a6e66ab req-8779860c-f563-494b-9e73-6b2f3dc6026f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b093877-20ab-4678-8d94-a89983bda325", "name": "network-vif-plugged", "status": "completed", "tag": "a7d32eab-b1e5-4dcd-bb06-5f06e6841586"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:09.364729 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:46:09.364729 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:46:09.374669 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-7399abe7-e0d2-4f00-a765-69329a6e66ab req-8779860c-f563-494b-9e73-6b2f3dc6026f service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:09.375116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-7399abe7-e0d2-4f00-a765-69329a6e66ab req-8779860c-f563-494b-9e73-6b2f3dc6026f service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:09.392932 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-7399abe7-e0d2-4f00-a765-69329a6e66ab req-8779860c-f563-494b-9e73-6b2f3dc6026f service nova] Creating event network-vif-plugged:a7d32eab-b1e5-4dcd-bb06-5f06e6841586 for instance 4b093877-20ab-4678-8d94-a89983bda325 on hv-cinder-79123 May 25 15:46:09.397762 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-7399abe7-e0d2-4f00-a765-69329a6e66ab req-8779860c-f563-494b-9e73-6b2f3dc6026f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038333 May 25 15:46:09.398541 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 388/797] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:46:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:46:09.928989 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5c2f0706-bf21-4b02-a7c0-a172e079ecf1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:09.929975 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5c2f0706-bf21-4b02-a7c0-a172e079ecf1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:09.939368 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5c2f0706-bf21-4b02-a7c0-a172e079ecf1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:09.939831 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5c2f0706-bf21-4b02-a7c0-a172e079ecf1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:09.941161 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5c2f0706-bf21-4b02-a7c0-a172e079ecf1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:09.941351 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5c2f0706-bf21-4b02-a7c0-a172e079ecf1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:10.149202 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5c2f0706-bf21-4b02-a7c0-a172e079ecf1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:10.149849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-80cd6906-b4dd-495c-ad2a-6095f281d0ee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:10.150876 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-80cd6906-b4dd-495c-ad2a-6095f281d0ee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:10.159322 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-80cd6906-b4dd-495c-ad2a-6095f281d0ee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:10.159524 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5c2f0706-bf21-4b02-a7c0-a172e079ecf1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1363 microversion: 2.1 time: 0.235178 May 25 15:46:10.160177 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-80cd6906-b4dd-495c-ad2a-6095f281d0ee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:10.160812 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 410/798] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:09 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:10.161051 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-80cd6906-b4dd-495c-ad2a-6095f281d0ee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:10.161933 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-80cd6906-b4dd-495c-ad2a-6095f281d0ee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:10.274093 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-80cd6906-b4dd-495c-ad2a-6095f281d0ee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 20148 microversion: 2.20 time: 0.128510 May 25 15:46:10.274760 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 389/799] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:10 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 20148 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:46:11.177408 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c788b36b-9e99-4b83-8b84-70d15a791aee tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:11.178657 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c788b36b-9e99-4b83-8b84-70d15a791aee tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:11.194535 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c788b36b-9e99-4b83-8b84-70d15a791aee tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:11.195814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c788b36b-9e99-4b83-8b84-70d15a791aee tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:11.196650 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c788b36b-9e99-4b83-8b84-70d15a791aee tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:11.197098 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c788b36b-9e99-4b83-8b84-70d15a791aee tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:11.286897 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7e36d61a-f466-41f0-8ad4-cc0779518899 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:11.288610 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7e36d61a-f466-41f0-8ad4-cc0779518899 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:11.297047 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7e36d61a-f466-41f0-8ad4-cc0779518899 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:11.297730 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7e36d61a-f466-41f0-8ad4-cc0779518899 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:11.299270 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7e36d61a-f466-41f0-8ad4-cc0779518899 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:11.299920 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7e36d61a-f466-41f0-8ad4-cc0779518899 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:11.433950 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7e36d61a-f466-41f0-8ad4-cc0779518899 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 21966 microversion: 2.20 time: 0.151298 May 25 15:46:11.436347 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 390/800] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:11 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 21966 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:46:11.439309 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c788b36b-9e99-4b83-8b84-70d15a791aee tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:11.449036 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c788b36b-9e99-4b83-8b84-70d15a791aee tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1549 microversion: 2.1 time: 0.275716 May 25 15:46:11.462853 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 411/801] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:11 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1549 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:11.470243 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8d9ce15b-3383-497c-8e74-cbbaf3cac1a3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:11.471027 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8d9ce15b-3383-497c-8e74-cbbaf3cac1a3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:11.479819 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8d9ce15b-3383-497c-8e74-cbbaf3cac1a3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:11.480331 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8d9ce15b-3383-497c-8e74-cbbaf3cac1a3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:11.481151 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8d9ce15b-3383-497c-8e74-cbbaf3cac1a3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:11.481632 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8d9ce15b-3383-497c-8e74-cbbaf3cac1a3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:11.733416 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8d9ce15b-3383-497c-8e74-cbbaf3cac1a3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.268664 May 25 15:46:11.734147 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 391/802] 10.222.0.36 () {58 vars in 1275 bytes} [Tue May 25 15:46:11 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-interface => generated 284 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:46:12.446594 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6b93dc0d-38a8-468d-9faf-7b8e1a2bd795 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:12.447443 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6b93dc0d-38a8-468d-9faf-7b8e1a2bd795 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:12.455137 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b93dc0d-38a8-468d-9faf-7b8e1a2bd795 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:12.455606 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b93dc0d-38a8-468d-9faf-7b8e1a2bd795 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:12.456440 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b93dc0d-38a8-468d-9faf-7b8e1a2bd795 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:12.456882 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b93dc0d-38a8-468d-9faf-7b8e1a2bd795 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:12.562645 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6b93dc0d-38a8-468d-9faf-7b8e1a2bd795 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 23227 microversion: 2.20 time: 0.119767 May 25 15:46:12.564537 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 412/803] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:12 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 23227 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:12.692273 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1294383475", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "networks": [{"uuid": "3c515845-6e63-4d8b-b829-eb7af03f0236"}]}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:12.757198 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] validate_networks() for [('3c515845-6e63-4d8b-b829-eb7af03f0236', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:46:13.259989 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:46:13.260532 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:46:13.261092 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:46:13.261637 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:46:13.262130 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:46:13.271402 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:13.271993 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:13.272877 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:13.273387 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:13.291485 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Getting quotas for project fd3e84780cc8404caa2bc8b9b90bcfab. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:46:13.295650 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Getting quotas for user a0a698a38cda4aa8827ed3bf664917f6 and project fd3e84780cc8404caa2bc8b9b90bcfab. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:46:13.307206 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:46:13.309681 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:46:13.356772 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-617af95d-9045-4837-99f6-c1c2ee993045 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669169 May 25 15:46:13.360008 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 392/804] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:46:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:46:13.369357 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a0db084f-0b92-4fe2-a15d-ba1adce04822 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:13.370264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a0db084f-0b92-4fe2-a15d-ba1adce04822 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:13.467282 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a0db084f-0b92-4fe2-a15d-ba1adce04822 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:13.481974 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-54fabb8a-4097-4c30-8d6f-04decb88ff4c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:13.483634 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-54fabb8a-4097-4c30-8d6f-04decb88ff4c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:13.484835 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a0db084f-0b92-4fe2-a15d-ba1adce04822 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1219 microversion: 2.1 time: 0.120247 May 25 15:46:13.493849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-54fabb8a-4097-4c30-8d6f-04decb88ff4c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:13.494467 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-54fabb8a-4097-4c30-8d6f-04decb88ff4c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:13.495409 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-54fabb8a-4097-4c30-8d6f-04decb88ff4c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:13.495953 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 413/805] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:13 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:13.496138 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-54fabb8a-4097-4c30-8d6f-04decb88ff4c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:13.505607 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-338e4455-ac2f-451a-906e-402220c58497 req-ea355b84-641b-4cc8-93f2-2265ab8dde34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b093877-20ab-4678-8d94-a89983bda325", "tag": "a7d32eab-b1e5-4dcd-bb06-5f06e6841586"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:13.507795 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:46:13.507795 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:46:13.520616 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-338e4455-ac2f-451a-906e-402220c58497 req-ea355b84-641b-4cc8-93f2-2265ab8dde34 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:13.521319 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-338e4455-ac2f-451a-906e-402220c58497 req-ea355b84-641b-4cc8-93f2-2265ab8dde34 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:13.538474 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-338e4455-ac2f-451a-906e-402220c58497 req-ea355b84-641b-4cc8-93f2-2265ab8dde34 service nova] Creating event network-changed:a7d32eab-b1e5-4dcd-bb06-5f06e6841586 for instance 4b093877-20ab-4678-8d94-a89983bda325 on hv-cinder-79123 May 25 15:46:13.543840 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-338e4455-ac2f-451a-906e-402220c58497 req-ea355b84-641b-4cc8-93f2-2265ab8dde34 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042659 May 25 15:46:13.544675 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 414/806] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:46:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:46:13.576282 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-da1d2e5c-2d51-4681-8170-6f60e91dc772 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:13.577916 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-da1d2e5c-2d51-4681-8170-6f60e91dc772 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:13.586408 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-da1d2e5c-2d51-4681-8170-6f60e91dc772 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:13.586868 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-da1d2e5c-2d51-4681-8170-6f60e91dc772 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:13.587807 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-da1d2e5c-2d51-4681-8170-6f60e91dc772 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:13.588305 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-da1d2e5c-2d51-4681-8170-6f60e91dc772 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:13.638904 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-54fabb8a-4097-4c30-8d6f-04decb88ff4c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.160071 May 25 15:46:13.641003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 393/807] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:13 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:46:13.705735 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-da1d2e5c-2d51-4681-8170-6f60e91dc772 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 24204 microversion: 2.20 time: 0.132603 May 25 15:46:13.711678 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 415/808] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:13 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 24204 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:46:14.503156 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ca789142-ac27-4044-bd26-80589d8758d1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:14.504433 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ca789142-ac27-4044-bd26-80589d8758d1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:14.517243 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca789142-ac27-4044-bd26-80589d8758d1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:14.518041 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca789142-ac27-4044-bd26-80589d8758d1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:14.519018 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca789142-ac27-4044-bd26-80589d8758d1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:14.519611 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca789142-ac27-4044-bd26-80589d8758d1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:14.651550 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e67cf662-51fe-4918-adfd-d6c3658b99fe tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:14.653852 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e67cf662-51fe-4918-adfd-d6c3658b99fe tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:14.664470 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e67cf662-51fe-4918-adfd-d6c3658b99fe tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:14.665127 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e67cf662-51fe-4918-adfd-d6c3658b99fe tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:14.666422 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e67cf662-51fe-4918-adfd-d6c3658b99fe tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:14.666863 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e67cf662-51fe-4918-adfd-d6c3658b99fe tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:14.700344 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ca789142-ac27-4044-bd26-80589d8758d1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:14.709993 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ca789142-ac27-4044-bd26-80589d8758d1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1279 microversion: 2.1 time: 0.211597 May 25 15:46:14.711254 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 394/809] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:14 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:14.718448 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c66253a1-9407-4372-a8b3-f0060b688da7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:14.720638 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c66253a1-9407-4372-a8b3-f0060b688da7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:14.728561 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c66253a1-9407-4372-a8b3-f0060b688da7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:14.729625 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c66253a1-9407-4372-a8b3-f0060b688da7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:14.730651 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c66253a1-9407-4372-a8b3-f0060b688da7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:14.731313 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c66253a1-9407-4372-a8b3-f0060b688da7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:14.797479 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e67cf662-51fe-4918-adfd-d6c3658b99fe tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.150772 May 25 15:46:14.798475 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 416/810] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:14 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:46:14.896951 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c66253a1-9407-4372-a8b3-f0060b688da7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 25083 microversion: 2.20 time: 0.182249 May 25 15:46:14.901530 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 395/811] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:14 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 25083 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:15.729683 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9b0362bc-2ca8-4263-b020-896b90f6eae4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:15.730414 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9b0362bc-2ca8-4263-b020-896b90f6eae4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:15.738957 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9b0362bc-2ca8-4263-b020-896b90f6eae4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:15.739421 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9b0362bc-2ca8-4263-b020-896b90f6eae4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:15.740245 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9b0362bc-2ca8-4263-b020-896b90f6eae4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:15.740696 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9b0362bc-2ca8-4263-b020-896b90f6eae4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:15.809436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-db915b3e-1ffb-4f9f-8847-f7d72ecc5e9a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:15.810463 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-db915b3e-1ffb-4f9f-8847-f7d72ecc5e9a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:15.822693 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-db915b3e-1ffb-4f9f-8847-f7d72ecc5e9a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:15.822693 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-db915b3e-1ffb-4f9f-8847-f7d72ecc5e9a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:15.822693 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-db915b3e-1ffb-4f9f-8847-f7d72ecc5e9a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:15.823081 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-db915b3e-1ffb-4f9f-8847-f7d72ecc5e9a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:15.933620 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-db915b3e-1ffb-4f9f-8847-f7d72ecc5e9a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.128556 May 25 15:46:15.937528 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 396/812] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:15 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 15:46:15.939791 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-76302977-b759-4cf2-aa00-775c0f15c2aa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:15.940922 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-76302977-b759-4cf2-aa00-775c0f15c2aa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:15.948909 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-76302977-b759-4cf2-aa00-775c0f15c2aa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:15.949372 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-76302977-b759-4cf2-aa00-775c0f15c2aa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:15.950163 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-76302977-b759-4cf2-aa00-775c0f15c2aa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:15.950611 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-76302977-b759-4cf2-aa00-775c0f15c2aa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:15.960250 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9b0362bc-2ca8-4263-b020-896b90f6eae4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:15.969025 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9b0362bc-2ca8-4263-b020-896b90f6eae4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1319 microversion: 2.1 time: 0.244362 May 25 15:46:15.970137 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 417/813] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:15 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:16.068263 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-76302977-b759-4cf2-aa00-775c0f15c2aa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 26216 microversion: 2.20 time: 0.132427 May 25 15:46:16.068926 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 397/814] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:15 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 26216 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:16.605317 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-35a0aec6-57ad-4dbc-9079-2a93aae6b10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7712bac3-f186-45b0-bf23-cd5e6c4b4664", "tag": "95018903-b76e-4499-90aa-6e8e90060c3c"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:16.606948 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:46:16.606948 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:46:16.616779 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-35a0aec6-57ad-4dbc-9079-2a93aae6b10a service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:16.617366 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-35a0aec6-57ad-4dbc-9079-2a93aae6b10a service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:16.634725 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-35a0aec6-57ad-4dbc-9079-2a93aae6b10a service nova] Creating event network-changed:95018903-b76e-4499-90aa-6e8e90060c3c for instance 7712bac3-f186-45b0-bf23-cd5e6c4b4664 on hv-cinder-79123 May 25 15:46:16.639829 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-35a0aec6-57ad-4dbc-9079-2a93aae6b10a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038112 May 25 15:46:16.640419 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 418/815] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:46:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:46:16.945844 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-08d227ce-a0a0-407f-8eaa-66e222872a83 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:16.946853 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-08d227ce-a0a0-407f-8eaa-66e222872a83 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:16.954899 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-08d227ce-a0a0-407f-8eaa-66e222872a83 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:16.955358 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-08d227ce-a0a0-407f-8eaa-66e222872a83 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:16.956173 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-08d227ce-a0a0-407f-8eaa-66e222872a83 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:16.956617 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-08d227ce-a0a0-407f-8eaa-66e222872a83 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:16.988002 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5d0082e9-af78-4aa3-8a73-1b386d35515b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:16.988701 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5d0082e9-af78-4aa3-8a73-1b386d35515b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:16.997755 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5d0082e9-af78-4aa3-8a73-1b386d35515b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:16.998213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5d0082e9-af78-4aa3-8a73-1b386d35515b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:16.999003 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5d0082e9-af78-4aa3-8a73-1b386d35515b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:16.999449 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5d0082e9-af78-4aa3-8a73-1b386d35515b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:17.075322 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-08d227ce-a0a0-407f-8eaa-66e222872a83 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.133480 May 25 15:46:17.078329 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 398/816] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:16 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:46:17.081363 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b3329e36-3312-4df7-a6c5-ecd34f6bb6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:17.082366 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b3329e36-3312-4df7-a6c5-ecd34f6bb6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:17.090371 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b3329e36-3312-4df7-a6c5-ecd34f6bb6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:17.090832 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b3329e36-3312-4df7-a6c5-ecd34f6bb6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:17.091610 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b3329e36-3312-4df7-a6c5-ecd34f6bb6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:17.092258 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b3329e36-3312-4df7-a6c5-ecd34f6bb6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:17.198883 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5d0082e9-af78-4aa3-8a73-1b386d35515b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:17.201374 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b3329e36-3312-4df7-a6c5-ecd34f6bb6fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 26964 microversion: 2.20 time: 0.123905 May 25 15:46:17.202231 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 399/817] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:17 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 26964 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:17.207680 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5d0082e9-af78-4aa3-8a73-1b386d35515b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1319 microversion: 2.1 time: 0.224915 May 25 15:46:17.208348 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 419/818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:16 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:18.086828 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3a7657df-f5da-4a48-b530-7e063774c63c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:18.087848 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3a7657df-f5da-4a48-b530-7e063774c63c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:18.097030 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3a7657df-f5da-4a48-b530-7e063774c63c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:18.097484 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3a7657df-f5da-4a48-b530-7e063774c63c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:18.098298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3a7657df-f5da-4a48-b530-7e063774c63c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:18.098737 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3a7657df-f5da-4a48-b530-7e063774c63c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:18.213136 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3a7657df-f5da-4a48-b530-7e063774c63c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.130342 May 25 15:46:18.213347 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-377c774c-715b-422c-a7f1-45ca76dc2f7b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:18.213819 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 400/819] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:18 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:46:18.214197 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-377c774c-715b-422c-a7f1-45ca76dc2f7b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:18.221575 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-377c774c-715b-422c-a7f1-45ca76dc2f7b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:18.222034 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-377c774c-715b-422c-a7f1-45ca76dc2f7b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:18.222815 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-377c774c-715b-422c-a7f1-45ca76dc2f7b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:18.223267 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-377c774c-715b-422c-a7f1-45ca76dc2f7b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:18.224330 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:18.225033 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:18.232859 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:18.233310 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:18.234078 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:18.234511 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:18.351647 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-377c774c-715b-422c-a7f1-45ca76dc2f7b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 27458 microversion: 2.20 time: 0.141827 May 25 15:46:18.352245 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 420/820] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:18 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 27458 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:46:18.469290 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:18.477584 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1319 microversion: 2.1 time: 0.257115 May 25 15:46:18.478165 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 401/821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:18 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:19.225845 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c343b191-7a8c-4e57-9cd9-02044783d123 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:19.226923 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c343b191-7a8c-4e57-9cd9-02044783d123 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:19.234884 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c343b191-7a8c-4e57-9cd9-02044783d123 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:19.235351 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c343b191-7a8c-4e57-9cd9-02044783d123 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:19.236164 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c343b191-7a8c-4e57-9cd9-02044783d123 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:19.236615 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c343b191-7a8c-4e57-9cd9-02044783d123 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:19.349683 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c343b191-7a8c-4e57-9cd9-02044783d123 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.128518 May 25 15:46:19.353245 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 421/822] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:19 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:46:19.362818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-06ce7079-c495-474a-a944-8fa61355b28b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:19.363898 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-06ce7079-c495-474a-a944-8fa61355b28b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:19.372128 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-06ce7079-c495-474a-a944-8fa61355b28b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:19.372589 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-06ce7079-c495-474a-a944-8fa61355b28b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:19.373438 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-06ce7079-c495-474a-a944-8fa61355b28b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:19.374209 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-06ce7079-c495-474a-a944-8fa61355b28b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:19.495383 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d36b05e6-bbf9-4b69-ac06-43e0d941a5e5 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:19.496416 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d36b05e6-bbf9-4b69-ac06-43e0d941a5e5 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:19.505379 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d36b05e6-bbf9-4b69-ac06-43e0d941a5e5 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:19.506030 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d36b05e6-bbf9-4b69-ac06-43e0d941a5e5 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:19.506938 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d36b05e6-bbf9-4b69-ac06-43e0d941a5e5 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:19.507492 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d36b05e6-bbf9-4b69-ac06-43e0d941a5e5 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:19.658985 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-06ce7079-c495-474a-a944-8fa61355b28b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 27704 microversion: 2.20 time: 0.299984 May 25 15:46:19.659674 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 402/823] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:19 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 27704 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:19.709367 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d36b05e6-bbf9-4b69-ac06-43e0d941a5e5 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:19.717532 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d36b05e6-bbf9-4b69-ac06-43e0d941a5e5 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1319 microversion: 2.1 time: 0.226431 May 25 15:46:19.718110 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 422/824] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:19 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:20.362186 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7b09a414-b7bc-4a75-bd3a-f80d171f0e47 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:20.363194 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7b09a414-b7bc-4a75-bd3a-f80d171f0e47 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:20.371077 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7b09a414-b7bc-4a75-bd3a-f80d171f0e47 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:20.371536 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7b09a414-b7bc-4a75-bd3a-f80d171f0e47 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:20.372342 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7b09a414-b7bc-4a75-bd3a-f80d171f0e47 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:20.372780 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7b09a414-b7bc-4a75-bd3a-f80d171f0e47 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:20.497436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7b09a414-b7bc-4a75-bd3a-f80d171f0e47 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.139879 May 25 15:46:20.498042 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 403/825] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:20 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:46:20.670637 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-dc313059-1685-410e-abd0-06b243b0cf01 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:20.671529 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-dc313059-1685-410e-abd0-06b243b0cf01 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:20.679283 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dc313059-1685-410e-abd0-06b243b0cf01 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:20.679749 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dc313059-1685-410e-abd0-06b243b0cf01 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:20.680569 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dc313059-1685-410e-abd0-06b243b0cf01 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:20.681016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dc313059-1685-410e-abd0-06b243b0cf01 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:20.733656 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-617f25da-62a4-465c-843a-928bd68a8681 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:20.734360 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-617f25da-62a4-465c-843a-928bd68a8681 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:20.742265 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-617f25da-62a4-465c-843a-928bd68a8681 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:20.742720 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-617f25da-62a4-465c-843a-928bd68a8681 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:20.743529 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-617f25da-62a4-465c-843a-928bd68a8681 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:20.744017 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-617f25da-62a4-465c-843a-928bd68a8681 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:20.806587 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-dc313059-1685-410e-abd0-06b243b0cf01 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 27882 microversion: 2.20 time: 0.139541 May 25 15:46:20.807474 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 423/826] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:20 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 27882 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:20.941679 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-617f25da-62a4-465c-843a-928bd68a8681 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:20.949748 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-617f25da-62a4-465c-843a-928bd68a8681 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1319 microversion: 2.1 time: 0.220293 May 25 15:46:20.950312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 404/827] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:20 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:21.407524 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-ebcc91a6-a6c2-407c-8bc2-268c91449856 req-5b9d4cc3-ecd7-4578-a6c6-89207a4d6155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7712bac3-f186-45b0-bf23-cd5e6c4b4664", "name": "network-vif-plugged", "status": "completed", "tag": "95018903-b76e-4499-90aa-6e8e90060c3c"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:21.409208 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:46:21.409208 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:46:21.418214 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-ebcc91a6-a6c2-407c-8bc2-268c91449856 req-5b9d4cc3-ecd7-4578-a6c6-89207a4d6155 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:21.418676 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-ebcc91a6-a6c2-407c-8bc2-268c91449856 req-5b9d4cc3-ecd7-4578-a6c6-89207a4d6155 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:21.437548 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-ebcc91a6-a6c2-407c-8bc2-268c91449856 req-5b9d4cc3-ecd7-4578-a6c6-89207a4d6155 service nova] Creating event network-vif-plugged:95018903-b76e-4499-90aa-6e8e90060c3c for instance 7712bac3-f186-45b0-bf23-cd5e6c4b4664 on hv-cinder-79123 May 25 15:46:21.442566 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-ebcc91a6-a6c2-407c-8bc2-268c91449856 req-5b9d4cc3-ecd7-4578-a6c6-89207a4d6155 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039455 May 25 15:46:21.443160 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 424/828] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:46:21.508602 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-96b25025-9373-4286-822b-414665b0cbb6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:21.509526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-96b25025-9373-4286-822b-414665b0cbb6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:21.517925 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-96b25025-9373-4286-822b-414665b0cbb6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:21.518387 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-96b25025-9373-4286-822b-414665b0cbb6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:21.519189 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-96b25025-9373-4286-822b-414665b0cbb6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:21.519630 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-96b25025-9373-4286-822b-414665b0cbb6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:21.662972 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-96b25025-9373-4286-822b-414665b0cbb6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.158241 May 25 15:46:21.663618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 405/829] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:21 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:46:21.819360 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5adfe931-e247-4f72-929e-febf929d1ad3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:21.820438 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5adfe931-e247-4f72-929e-febf929d1ad3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:21.828001 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5adfe931-e247-4f72-929e-febf929d1ad3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:21.828467 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5adfe931-e247-4f72-929e-febf929d1ad3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:21.829297 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5adfe931-e247-4f72-929e-febf929d1ad3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:21.829708 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5adfe931-e247-4f72-929e-febf929d1ad3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:21.967631 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6955f202-e743-47ee-ac57-f1b1578e3417 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:21.968362 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6955f202-e743-47ee-ac57-f1b1578e3417 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:21.970399 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5adfe931-e247-4f72-929e-febf929d1ad3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28188 microversion: 2.20 time: 0.154591 May 25 15:46:21.974296 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 425/830] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:21 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28188 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:21.977059 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6955f202-e743-47ee-ac57-f1b1578e3417 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:21.977511 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6955f202-e743-47ee-ac57-f1b1578e3417 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:21.978285 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6955f202-e743-47ee-ac57-f1b1578e3417 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:21.978721 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6955f202-e743-47ee-ac57-f1b1578e3417 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:22.172150 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-6955f202-e743-47ee-ac57-f1b1578e3417 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:22.180266 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6955f202-e743-47ee-ac57-f1b1578e3417 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1319 microversion: 2.1 time: 0.216903 May 25 15:46:22.180826 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 406/831] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:21 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:22.674288 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8b802d83-bfc1-4f1a-9456-e4fcb55ed939 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:22.675310 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8b802d83-bfc1-4f1a-9456-e4fcb55ed939 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:22.682990 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b802d83-bfc1-4f1a-9456-e4fcb55ed939 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:22.683454 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b802d83-bfc1-4f1a-9456-e4fcb55ed939 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:22.686146 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b802d83-bfc1-4f1a-9456-e4fcb55ed939 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:22.686702 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b802d83-bfc1-4f1a-9456-e4fcb55ed939 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:22.814147 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8b802d83-bfc1-4f1a-9456-e4fcb55ed939 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.144271 May 25 15:46:22.814660 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 426/832] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:22 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:46:22.981975 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3286f780-ca92-40cb-9987-1938c2496533 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:22.982799 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3286f780-ca92-40cb-9987-1938c2496533 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:22.990418 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3286f780-ca92-40cb-9987-1938c2496533 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:22.990870 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3286f780-ca92-40cb-9987-1938c2496533 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:22.991632 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3286f780-ca92-40cb-9987-1938c2496533 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:22.992103 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3286f780-ca92-40cb-9987-1938c2496533 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:23.121419 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3286f780-ca92-40cb-9987-1938c2496533 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28248 microversion: 2.20 time: 0.143018 May 25 15:46:23.122782 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 407/833] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:22 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28248 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:23.196344 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3c04ad00-2586-448b-843b-1e0876e56ca9 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:23.197053 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-3c04ad00-2586-448b-843b-1e0876e56ca9 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:23.205449 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3c04ad00-2586-448b-843b-1e0876e56ca9 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:23.205898 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3c04ad00-2586-448b-843b-1e0876e56ca9 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:23.206668 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3c04ad00-2586-448b-843b-1e0876e56ca9 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:23.207103 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3c04ad00-2586-448b-843b-1e0876e56ca9 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:23.408893 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3c04ad00-2586-448b-843b-1e0876e56ca9 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:23.417348 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3c04ad00-2586-448b-843b-1e0876e56ca9 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1507 microversion: 2.1 time: 0.225123 May 25 15:46:23.417923 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 427/834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:23 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:23.826139 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-69ab3ea5-ea3b-4924-a3ca-bb65ddfd96ad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:23.827161 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-69ab3ea5-ea3b-4924-a3ca-bb65ddfd96ad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:23.835694 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-69ab3ea5-ea3b-4924-a3ca-bb65ddfd96ad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:23.836192 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-69ab3ea5-ea3b-4924-a3ca-bb65ddfd96ad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:23.836986 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-69ab3ea5-ea3b-4924-a3ca-bb65ddfd96ad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:23.837429 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-69ab3ea5-ea3b-4924-a3ca-bb65ddfd96ad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:23.979169 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-69ab3ea5-ea3b-4924-a3ca-bb65ddfd96ad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.157080 May 25 15:46:23.982404 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 408/835] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:23 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:46:24.133977 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6e3e89bb-defa-4226-81e3-7bce7cd3ca34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:24.134828 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6e3e89bb-defa-4226-81e3-7bce7cd3ca34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:24.142252 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6e3e89bb-defa-4226-81e3-7bce7cd3ca34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:24.142718 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6e3e89bb-defa-4226-81e3-7bce7cd3ca34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:24.143511 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6e3e89bb-defa-4226-81e3-7bce7cd3ca34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:24.143990 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6e3e89bb-defa-4226-81e3-7bce7cd3ca34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:24.265728 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6e3e89bb-defa-4226-81e3-7bce7cd3ca34 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28248 microversion: 2.20 time: 0.135422 May 25 15:46:24.266343 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 428/836] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:24 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28248 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:24.990627 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7ad20863-c785-4a2c-b7e6-53d377379669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:24.991628 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7ad20863-c785-4a2c-b7e6-53d377379669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:25.000008 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7ad20863-c785-4a2c-b7e6-53d377379669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:25.000465 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7ad20863-c785-4a2c-b7e6-53d377379669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:25.001739 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7ad20863-c785-4a2c-b7e6-53d377379669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:25.002179 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7ad20863-c785-4a2c-b7e6-53d377379669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:25.127550 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7ad20863-c785-4a2c-b7e6-53d377379669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.140848 May 25 15:46:25.128254 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 409/837] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:24 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:46:25.278223 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-098a3fc0-5d7e-43c7-b4c4-5466eee9bfc2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:25.279316 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-098a3fc0-5d7e-43c7-b4c4-5466eee9bfc2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:25.287825 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-098a3fc0-5d7e-43c7-b4c4-5466eee9bfc2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:25.288408 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-098a3fc0-5d7e-43c7-b4c4-5466eee9bfc2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:25.289198 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-098a3fc0-5d7e-43c7-b4c4-5466eee9bfc2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:25.289645 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-098a3fc0-5d7e-43c7-b4c4-5466eee9bfc2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:25.423697 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-098a3fc0-5d7e-43c7-b4c4-5466eee9bfc2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28248 microversion: 2.20 time: 0.148979 May 25 15:46:25.424390 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 429/838] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:25 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28248 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:26.139688 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-437b0a33-3759-48c8-9ea6-a9bc2ccaa2b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:26.140746 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-437b0a33-3759-48c8-9ea6-a9bc2ccaa2b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:26.151228 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-437b0a33-3759-48c8-9ea6-a9bc2ccaa2b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:26.151699 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-437b0a33-3759-48c8-9ea6-a9bc2ccaa2b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:26.152546 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-437b0a33-3759-48c8-9ea6-a9bc2ccaa2b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:26.153435 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-437b0a33-3759-48c8-9ea6-a9bc2ccaa2b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:26.301331 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-437b0a33-3759-48c8-9ea6-a9bc2ccaa2b4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.166108 May 25 15:46:26.301980 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 410/839] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:26 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:46:26.436658 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-59cbea8a-179f-4e87-b568-e86a7b453124 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:26.437615 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-59cbea8a-179f-4e87-b568-e86a7b453124 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:26.446096 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-59cbea8a-179f-4e87-b568-e86a7b453124 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:26.446548 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-59cbea8a-179f-4e87-b568-e86a7b453124 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:26.447317 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-59cbea8a-179f-4e87-b568-e86a7b453124 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:26.447778 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-59cbea8a-179f-4e87-b568-e86a7b453124 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:26.565952 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-59cbea8a-179f-4e87-b568-e86a7b453124 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28459 microversion: 2.20 time: 0.133468 May 25 15:46:26.566633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 430/840] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:26 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28459 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:27.313575 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9162ac34-6c73-44b3-96a7-2bee9bc58000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:27.314584 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9162ac34-6c73-44b3-96a7-2bee9bc58000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:27.322975 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9162ac34-6c73-44b3-96a7-2bee9bc58000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:27.323452 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9162ac34-6c73-44b3-96a7-2bee9bc58000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:27.324521 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9162ac34-6c73-44b3-96a7-2bee9bc58000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:27.324967 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9162ac34-6c73-44b3-96a7-2bee9bc58000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:27.439705 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9162ac34-6c73-44b3-96a7-2bee9bc58000 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14 microversion: 2.1 time: 0.130290 May 25 15:46:27.440552 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 411/841] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:27 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:46:27.577294 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-83984ea6-5487-497a-8365-6c4b3ad665e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:27.578324 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-83984ea6-5487-497a-8365-6c4b3ad665e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:27.586841 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-83984ea6-5487-497a-8365-6c4b3ad665e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:27.587296 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-83984ea6-5487-497a-8365-6c4b3ad665e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:27.588108 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-83984ea6-5487-497a-8365-6c4b3ad665e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:27.588547 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-83984ea6-5487-497a-8365-6c4b3ad665e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:27.694868 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-83984ea6-5487-497a-8365-6c4b3ad665e3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28538 microversion: 2.20 time: 0.121489 May 25 15:46:27.695428 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 431/842] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:27 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28538 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:28.451186 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7931c04f-e990-48f7-8768-83f77cba64e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:28.452387 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7931c04f-e990-48f7-8768-83f77cba64e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:28.461172 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7931c04f-e990-48f7-8768-83f77cba64e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:28.461887 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7931c04f-e990-48f7-8768-83f77cba64e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:28.462683 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7931c04f-e990-48f7-8768-83f77cba64e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:28.463132 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7931c04f-e990-48f7-8768-83f77cba64e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:28.592049 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7931c04f-e990-48f7-8768-83f77cba64e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 4454 microversion: 2.1 time: 0.144679 May 25 15:46:28.592602 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 412/843] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:28 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 4454 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:28.707926 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b08daf45-7c59-4e50-8fc2-c5a77eb641d1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:28.709010 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b08daf45-7c59-4e50-8fc2-c5a77eb641d1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:28.716971 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b08daf45-7c59-4e50-8fc2-c5a77eb641d1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:28.717439 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b08daf45-7c59-4e50-8fc2-c5a77eb641d1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:28.718220 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b08daf45-7c59-4e50-8fc2-c5a77eb641d1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:28.718667 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b08daf45-7c59-4e50-8fc2-c5a77eb641d1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:28.847922 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b08daf45-7c59-4e50-8fc2-c5a77eb641d1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28706 microversion: 2.20 time: 0.144517 May 25 15:46:28.848489 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 432/844] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:28 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28706 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:29.604088 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ce3f0565-473a-48c8-99df-d482a29b3c32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:29.605022 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ce3f0565-473a-48c8-99df-d482a29b3c32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:29.613733 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce3f0565-473a-48c8-99df-d482a29b3c32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:29.614201 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce3f0565-473a-48c8-99df-d482a29b3c32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:29.614983 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce3f0565-473a-48c8-99df-d482a29b3c32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:29.615429 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ce3f0565-473a-48c8-99df-d482a29b3c32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:29.734834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ce3f0565-473a-48c8-99df-d482a29b3c32 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 9847 microversion: 2.1 time: 0.135136 May 25 15:46:29.735522 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 413/845] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:29 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 9847 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:29.859656 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7a38b5aa-7cab-4166-a09e-0557807e696b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:29.860936 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7a38b5aa-7cab-4166-a09e-0557807e696b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:29.869058 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7a38b5aa-7cab-4166-a09e-0557807e696b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:29.869520 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7a38b5aa-7cab-4166-a09e-0557807e696b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:29.870319 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7a38b5aa-7cab-4166-a09e-0557807e696b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:29.870746 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7a38b5aa-7cab-4166-a09e-0557807e696b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:29.992572 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7a38b5aa-7cab-4166-a09e-0557807e696b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28706 microversion: 2.20 time: 0.137148 May 25 15:46:29.993228 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 433/846] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:29 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28706 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:30.746822 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-12a008cf-3d6c-481c-9d58-8b8605c05a37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:30.747844 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-12a008cf-3d6c-481c-9d58-8b8605c05a37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:30.756423 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-12a008cf-3d6c-481c-9d58-8b8605c05a37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:30.756878 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-12a008cf-3d6c-481c-9d58-8b8605c05a37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:30.757655 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-12a008cf-3d6c-481c-9d58-8b8605c05a37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:30.758095 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-12a008cf-3d6c-481c-9d58-8b8605c05a37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:30.877802 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-12a008cf-3d6c-481c-9d58-8b8605c05a37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 14558 microversion: 2.1 time: 0.134939 May 25 15:46:30.878498 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 414/847] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:30 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 14558 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:31.005013 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-92d6b942-9372-4366-baf4-109d68062b61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:31.005965 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-92d6b942-9372-4366-baf4-109d68062b61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:31.014345 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-92d6b942-9372-4366-baf4-109d68062b61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:31.014798 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-92d6b942-9372-4366-baf4-109d68062b61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:31.015574 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-92d6b942-9372-4366-baf4-109d68062b61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:31.016066 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-92d6b942-9372-4366-baf4-109d68062b61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:31.135490 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-92d6b942-9372-4366-baf4-109d68062b61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28706 microversion: 2.20 time: 0.134556 May 25 15:46:31.136172 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 434/848] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:30 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28706 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:31.890008 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1f31683d-abe5-41e2-8699-579eaa4a63da tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:31.890985 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1f31683d-abe5-41e2-8699-579eaa4a63da tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:31.902976 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1f31683d-abe5-41e2-8699-579eaa4a63da tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:31.903435 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1f31683d-abe5-41e2-8699-579eaa4a63da tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:31.904262 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1f31683d-abe5-41e2-8699-579eaa4a63da tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:31.904817 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1f31683d-abe5-41e2-8699-579eaa4a63da tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:32.037296 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1f31683d-abe5-41e2-8699-579eaa4a63da tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 17508 microversion: 2.1 time: 0.151656 May 25 15:46:32.037942 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 415/849] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:31 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 17508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:32.147771 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-078b14aa-1319-4a42-82c6-c54e3ad9554c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:32.148740 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-078b14aa-1319-4a42-82c6-c54e3ad9554c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:32.156835 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-078b14aa-1319-4a42-82c6-c54e3ad9554c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:32.157294 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-078b14aa-1319-4a42-82c6-c54e3ad9554c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:32.158087 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-078b14aa-1319-4a42-82c6-c54e3ad9554c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:32.158523 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-078b14aa-1319-4a42-82c6-c54e3ad9554c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:32.273899 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-078b14aa-1319-4a42-82c6-c54e3ad9554c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28706 microversion: 2.20 time: 0.130276 May 25 15:46:32.274543 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 435/850] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:32 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28706 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:46:33.049400 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c372ddf7-bf29-4be8-b7c7-5e35e93ebd7b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:33.050416 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c372ddf7-bf29-4be8-b7c7-5e35e93ebd7b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:33.058334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c372ddf7-bf29-4be8-b7c7-5e35e93ebd7b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:33.058794 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c372ddf7-bf29-4be8-b7c7-5e35e93ebd7b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:33.059566 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c372ddf7-bf29-4be8-b7c7-5e35e93ebd7b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:33.060038 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c372ddf7-bf29-4be8-b7c7-5e35e93ebd7b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:33.178188 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c372ddf7-bf29-4be8-b7c7-5e35e93ebd7b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 17744 microversion: 2.1 time: 0.132767 May 25 15:46:33.178844 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 416/851] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:33 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 17744 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:46:33.286552 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-96fbe317-9fcc-4ae7-82a0-f56543b72ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:33.287600 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-96fbe317-9fcc-4ae7-82a0-f56543b72ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:33.295520 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-96fbe317-9fcc-4ae7-82a0-f56543b72ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:33.296022 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-96fbe317-9fcc-4ae7-82a0-f56543b72ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:33.296825 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-96fbe317-9fcc-4ae7-82a0-f56543b72ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:33.297278 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-96fbe317-9fcc-4ae7-82a0-f56543b72ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:33.417009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-96fbe317-9fcc-4ae7-82a0-f56543b72ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28706 microversion: 2.20 time: 0.134451 May 25 15:46:33.417687 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 436/852] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:33 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28706 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:34.191304 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2c56d1e1-8ea8-43a1-9951-d9d4dd1b57a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:34.192375 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2c56d1e1-8ea8-43a1-9951-d9d4dd1b57a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:34.200410 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2c56d1e1-8ea8-43a1-9951-d9d4dd1b57a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:34.200876 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2c56d1e1-8ea8-43a1-9951-d9d4dd1b57a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:34.201671 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2c56d1e1-8ea8-43a1-9951-d9d4dd1b57a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:34.202145 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2c56d1e1-8ea8-43a1-9951-d9d4dd1b57a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:34.315136 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2c56d1e1-8ea8-43a1-9951-d9d4dd1b57a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 19342 microversion: 2.1 time: 0.127921 May 25 15:46:34.315781 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 417/853] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:34 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 19342 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:34.429709 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7b18fd2d-de31-49c0-8aa9-188d264dd662 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:34.430724 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7b18fd2d-de31-49c0-8aa9-188d264dd662 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:34.438998 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7b18fd2d-de31-49c0-8aa9-188d264dd662 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:34.439548 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7b18fd2d-de31-49c0-8aa9-188d264dd662 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:34.440282 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7b18fd2d-de31-49c0-8aa9-188d264dd662 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:34.440727 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7b18fd2d-de31-49c0-8aa9-188d264dd662 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:34.563808 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7b18fd2d-de31-49c0-8aa9-188d264dd662 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28706 microversion: 2.20 time: 0.138149 May 25 15:46:34.564522 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 437/854] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:34 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28706 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:35.327309 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-88a81584-bec9-451c-b751-f12ba5dc3b0e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:35.328494 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-88a81584-bec9-451c-b751-f12ba5dc3b0e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:35.337315 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-88a81584-bec9-451c-b751-f12ba5dc3b0e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:35.337777 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-88a81584-bec9-451c-b751-f12ba5dc3b0e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:35.338732 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-88a81584-bec9-451c-b751-f12ba5dc3b0e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:35.339174 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-88a81584-bec9-451c-b751-f12ba5dc3b0e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:35.454282 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-88a81584-bec9-451c-b751-f12ba5dc3b0e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 20991 microversion: 2.1 time: 0.130972 May 25 15:46:35.454854 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 418/855] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:35 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 20991 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:35.576180 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a06039fe-535c-42ae-9b45-d84388aa7491 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:35.577205 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a06039fe-535c-42ae-9b45-d84388aa7491 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:35.585751 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a06039fe-535c-42ae-9b45-d84388aa7491 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:35.586248 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a06039fe-535c-42ae-9b45-d84388aa7491 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:35.587031 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a06039fe-535c-42ae-9b45-d84388aa7491 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:35.587480 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a06039fe-535c-42ae-9b45-d84388aa7491 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:35.695307 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a06039fe-535c-42ae-9b45-d84388aa7491 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28706 microversion: 2.20 time: 0.123176 May 25 15:46:35.695969 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 438/856] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:35 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28706 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:36.466999 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-227d8cc7-efbb-4cdd-8388-0acfbdd4952f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:36.468045 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-227d8cc7-efbb-4cdd-8388-0acfbdd4952f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:36.476149 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-227d8cc7-efbb-4cdd-8388-0acfbdd4952f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:36.476612 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-227d8cc7-efbb-4cdd-8388-0acfbdd4952f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:36.477384 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-227d8cc7-efbb-4cdd-8388-0acfbdd4952f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:36.477822 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-227d8cc7-efbb-4cdd-8388-0acfbdd4952f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:36.613935 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-227d8cc7-efbb-4cdd-8388-0acfbdd4952f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 22541 microversion: 2.1 time: 0.150937 May 25 15:46:36.614586 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 419/857] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:36 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 22541 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:36.707821 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8f7d339f-408c-45e3-bb44-5bff168a1bee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:36.708875 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8f7d339f-408c-45e3-bb44-5bff168a1bee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:36.716829 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f7d339f-408c-45e3-bb44-5bff168a1bee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:36.717351 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f7d339f-408c-45e3-bb44-5bff168a1bee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:36.718077 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f7d339f-408c-45e3-bb44-5bff168a1bee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:36.718532 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f7d339f-408c-45e3-bb44-5bff168a1bee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:36.839504 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8f7d339f-408c-45e3-bb44-5bff168a1bee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 28706 microversion: 2.20 time: 0.136165 May 25 15:46:36.840215 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 439/858] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:36 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 28706 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:37.626368 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a884969f-3051-423e-9411-898fa0e0276c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:37.627275 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a884969f-3051-423e-9411-898fa0e0276c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:37.635921 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a884969f-3051-423e-9411-898fa0e0276c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:37.636392 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a884969f-3051-423e-9411-898fa0e0276c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:37.637145 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a884969f-3051-423e-9411-898fa0e0276c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:37.637583 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a884969f-3051-423e-9411-898fa0e0276c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:37.756598 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a884969f-3051-423e-9411-898fa0e0276c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 23225 microversion: 2.1 time: 0.134465 May 25 15:46:37.757257 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 420/859] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:37 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 23225 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:37.853192 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ca406436-ef90-4e65-b126-0a43c7460c21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:37.854209 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ca406436-ef90-4e65-b126-0a43c7460c21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:37.862628 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ca406436-ef90-4e65-b126-0a43c7460c21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:37.863094 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ca406436-ef90-4e65-b126-0a43c7460c21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:37.863907 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ca406436-ef90-4e65-b126-0a43c7460c21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:37.864357 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ca406436-ef90-4e65-b126-0a43c7460c21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:37.986554 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ca406436-ef90-4e65-b126-0a43c7460c21 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 29316 microversion: 2.20 time: 0.139087 May 25 15:46:37.987285 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 440/860] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:37 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 29316 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:38.768701 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c311d587-8c06-4c3c-b4e0-d9c0f573c77c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:38.769808 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c311d587-8c06-4c3c-b4e0-d9c0f573c77c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:38.777725 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c311d587-8c06-4c3c-b4e0-d9c0f573c77c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:38.778187 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c311d587-8c06-4c3c-b4e0-d9c0f573c77c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:38.778965 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c311d587-8c06-4c3c-b4e0-d9c0f573c77c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:38.779410 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c311d587-8c06-4c3c-b4e0-d9c0f573c77c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:38.889992 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c311d587-8c06-4c3c-b4e0-d9c0f573c77c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 23909 microversion: 2.1 time: 0.125355 May 25 15:46:38.890658 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 421/861] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:38 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 23909 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:38.999686 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5a59051b-6d9b-4142-8126-5a358f3a3fdc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:39.000733 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5a59051b-6d9b-4142-8126-5a358f3a3fdc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:39.009277 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5a59051b-6d9b-4142-8126-5a358f3a3fdc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:39.009742 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5a59051b-6d9b-4142-8126-5a358f3a3fdc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:39.010530 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5a59051b-6d9b-4142-8126-5a358f3a3fdc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:39.011072 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5a59051b-6d9b-4142-8126-5a358f3a3fdc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:39.127485 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5a59051b-6d9b-4142-8126-5a358f3a3fdc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 30518 microversion: 2.20 time: 0.131946 May 25 15:46:39.128065 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 441/862] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:38 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 30518 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:39.903538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2df8731d-dbae-4296-b4d9-6c675253cb3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:39.905324 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2df8731d-dbae-4296-b4d9-6c675253cb3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:39.915441 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2df8731d-dbae-4296-b4d9-6c675253cb3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:39.919742 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2df8731d-dbae-4296-b4d9-6c675253cb3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:39.920934 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2df8731d-dbae-4296-b4d9-6c675253cb3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:39.921443 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2df8731d-dbae-4296-b4d9-6c675253cb3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:40.069842 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2df8731d-dbae-4296-b4d9-6c675253cb3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 24742 microversion: 2.1 time: 0.171738 May 25 15:46:40.070452 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 422/863] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:39 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 24742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:40.139820 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c0a32ffc-c8dd-4899-8968-bf2f7d3bc68a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:40.141196 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c0a32ffc-c8dd-4899-8968-bf2f7d3bc68a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:40.150095 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c0a32ffc-c8dd-4899-8968-bf2f7d3bc68a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:40.150673 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c0a32ffc-c8dd-4899-8968-bf2f7d3bc68a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:40.151483 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c0a32ffc-c8dd-4899-8968-bf2f7d3bc68a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:40.151957 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c0a32ffc-c8dd-4899-8968-bf2f7d3bc68a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:40.277693 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c0a32ffc-c8dd-4899-8968-bf2f7d3bc68a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 31610 microversion: 2.20 time: 0.142277 May 25 15:46:40.278348 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 442/864] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:40 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 31610 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:40.622553 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:46:40.622800 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: Tue May 25 15:46:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:46:41.082701 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d27789f4-da04-4729-87ee-58d9a8536684 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:41.083709 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d27789f4-da04-4729-87ee-58d9a8536684 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:41.092384 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d27789f4-da04-4729-87ee-58d9a8536684 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:41.092873 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d27789f4-da04-4729-87ee-58d9a8536684 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:41.093673 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d27789f4-da04-4729-87ee-58d9a8536684 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:41.094116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d27789f4-da04-4729-87ee-58d9a8536684 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:41.226769 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d27789f4-da04-4729-87ee-58d9a8536684 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 25595 microversion: 2.1 time: 0.148690 May 25 15:46:41.227691 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 423/865] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:41 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 25595 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:41.290693 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bbef3b18-565d-4fe8-ade5-0ab15fd64e09 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:41.291701 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bbef3b18-565d-4fe8-ade5-0ab15fd64e09 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:41.299990 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bbef3b18-565d-4fe8-ade5-0ab15fd64e09 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:41.300453 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bbef3b18-565d-4fe8-ade5-0ab15fd64e09 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:41.301889 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bbef3b18-565d-4fe8-ade5-0ab15fd64e09 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:41.302335 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bbef3b18-565d-4fe8-ade5-0ab15fd64e09 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:41.424059 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bbef3b18-565d-4fe8-ade5-0ab15fd64e09 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 32406 microversion: 2.20 time: 0.137251 May 25 15:46:41.425496 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 443/866] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:41 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 32406 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:42.241041 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-68838dea-4ddb-4c17-ba69-d2c244e5ada5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:42.242150 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-68838dea-4ddb-4c17-ba69-d2c244e5ada5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:42.250000 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-68838dea-4ddb-4c17-ba69-d2c244e5ada5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:42.250459 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-68838dea-4ddb-4c17-ba69-d2c244e5ada5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:42.251239 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-68838dea-4ddb-4c17-ba69-d2c244e5ada5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:42.251687 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-68838dea-4ddb-4c17-ba69-d2c244e5ada5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:42.369424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-68838dea-4ddb-4c17-ba69-d2c244e5ada5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 26223 microversion: 2.1 time: 0.132282 May 25 15:46:42.370090 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 424/867] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:42 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 26223 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:42.437238 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bd2c3240-6e92-4068-b0b9-254bc44ddba7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:42.438284 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bd2c3240-6e92-4068-b0b9-254bc44ddba7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:42.446830 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd2c3240-6e92-4068-b0b9-254bc44ddba7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:42.447292 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd2c3240-6e92-4068-b0b9-254bc44ddba7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:42.448104 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd2c3240-6e92-4068-b0b9-254bc44ddba7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:42.448552 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd2c3240-6e92-4068-b0b9-254bc44ddba7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:42.569277 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bd2c3240-6e92-4068-b0b9-254bc44ddba7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 32883 microversion: 2.20 time: 0.135980 May 25 15:46:42.569924 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 444/868] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:42 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 32883 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:43.383240 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-64b4adb5-ee17-4a60-bc63-239795b6d3d8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:43.384299 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-64b4adb5-ee17-4a60-bc63-239795b6d3d8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:43.392654 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-64b4adb5-ee17-4a60-bc63-239795b6d3d8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:43.393111 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-64b4adb5-ee17-4a60-bc63-239795b6d3d8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:43.393885 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-64b4adb5-ee17-4a60-bc63-239795b6d3d8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:43.394326 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-64b4adb5-ee17-4a60-bc63-239795b6d3d8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:43.537489 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-64b4adb5-ee17-4a60-bc63-239795b6d3d8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 26821 microversion: 2.1 time: 0.159617 May 25 15:46:43.538127 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 425/869] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:43 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 26821 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:43.581471 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-95602a30-21c9-4494-a777-e6f8c99a0626 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:43.582549 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-95602a30-21c9-4494-a777-e6f8c99a0626 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:43.590658 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-95602a30-21c9-4494-a777-e6f8c99a0626 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:43.591114 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-95602a30-21c9-4494-a777-e6f8c99a0626 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:43.592099 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-95602a30-21c9-4494-a777-e6f8c99a0626 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:43.592542 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-95602a30-21c9-4494-a777-e6f8c99a0626 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:43.741187 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-95602a30-21c9-4494-a777-e6f8c99a0626 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 33338 microversion: 2.20 time: 0.163707 May 25 15:46:43.742203 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 445/870] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:43 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 33338 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:44.549845 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b1d965b8-607e-46be-be1e-20258cf72eb4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:44.550842 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b1d965b8-607e-46be-be1e-20258cf72eb4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:44.559351 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b1d965b8-607e-46be-be1e-20258cf72eb4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:44.559803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b1d965b8-607e-46be-be1e-20258cf72eb4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:44.560599 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b1d965b8-607e-46be-be1e-20258cf72eb4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:44.561038 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b1d965b8-607e-46be-be1e-20258cf72eb4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:44.682902 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b1d965b8-607e-46be-be1e-20258cf72eb4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 27283 microversion: 2.1 time: 0.136945 May 25 15:46:44.687124 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 426/871] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:44 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 27283 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:44.753431 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-26606984-c1c2-45bd-b283-96aa9fd5a2cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:44.754479 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-26606984-c1c2-45bd-b283-96aa9fd5a2cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:44.762896 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-26606984-c1c2-45bd-b283-96aa9fd5a2cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:44.763358 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-26606984-c1c2-45bd-b283-96aa9fd5a2cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:44.764432 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-26606984-c1c2-45bd-b283-96aa9fd5a2cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:44.764873 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-26606984-c1c2-45bd-b283-96aa9fd5a2cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:44.875626 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-26606984-c1c2-45bd-b283-96aa9fd5a2cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 33710 microversion: 2.20 time: 0.126250 May 25 15:46:44.876293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 446/872] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:44 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 33710 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:45.695098 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-597fd2a9-8426-433b-ac4b-7cade68e7b2f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:45.696085 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-597fd2a9-8426-433b-ac4b-7cade68e7b2f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:45.704031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-597fd2a9-8426-433b-ac4b-7cade68e7b2f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:45.704494 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-597fd2a9-8426-433b-ac4b-7cade68e7b2f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:45.705277 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-597fd2a9-8426-433b-ac4b-7cade68e7b2f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:45.705723 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-597fd2a9-8426-433b-ac4b-7cade68e7b2f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:45.817450 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-597fd2a9-8426-433b-ac4b-7cade68e7b2f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 27678 microversion: 2.1 time: 0.126468 May 25 15:46:45.818849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 427/873] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:45 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 27678 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:45.887463 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7d1c7c00-76b7-49ca-b7f3-d583c54dc0dc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:45.888522 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7d1c7c00-76b7-49ca-b7f3-d583c54dc0dc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:45.896830 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7d1c7c00-76b7-49ca-b7f3-d583c54dc0dc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:45.897297 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7d1c7c00-76b7-49ca-b7f3-d583c54dc0dc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:45.898082 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7d1c7c00-76b7-49ca-b7f3-d583c54dc0dc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:45.898530 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7d1c7c00-76b7-49ca-b7f3-d583c54dc0dc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:46.033126 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7d1c7c00-76b7-49ca-b7f3-d583c54dc0dc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 34416 microversion: 2.20 time: 0.149667 May 25 15:46:46.034020 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 447/874] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:45 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 34416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:46:46.830156 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-94700a42-2cd3-46a4-a30b-040de0a37299 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:46.831143 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-94700a42-2cd3-46a4-a30b-040de0a37299 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:46.839094 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-94700a42-2cd3-46a4-a30b-040de0a37299 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:46.839561 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-94700a42-2cd3-46a4-a30b-040de0a37299 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:46.840414 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-94700a42-2cd3-46a4-a30b-040de0a37299 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:46.840859 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-94700a42-2cd3-46a4-a30b-040de0a37299 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:46.921631 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-861713b7-1c7c-4839-8b2f-e9be33c2da3e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ed1f743-0cdc-4739-b290-1c87b2d795d2", "device": "/dev/sdb"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:46.923310 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-861713b7-1c7c-4839-8b2f-e9be33c2da3e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:46.931583 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-861713b7-1c7c-4839-8b2f-e9be33c2da3e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:46.932065 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-861713b7-1c7c-4839-8b2f-e9be33c2da3e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:46.932847 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-861713b7-1c7c-4839-8b2f-e9be33c2da3e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:46.933286 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-861713b7-1c7c-4839-8b2f-e9be33c2da3e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:46.977048 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-94700a42-2cd3-46a4-a30b-040de0a37299 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 27911 microversion: 2.1 time: 0.151160 May 25 15:46:46.978834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 428/875] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:46 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 27911 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:47.046095 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-925d38ec-cded-4b5e-a2f2-975c300e1894 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:47.047116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-925d38ec-cded-4b5e-a2f2-975c300e1894 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:47.056293 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-925d38ec-cded-4b5e-a2f2-975c300e1894 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:47.056762 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-925d38ec-cded-4b5e-a2f2-975c300e1894 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:47.057554 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-925d38ec-cded-4b5e-a2f2-975c300e1894 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:47.057998 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-925d38ec-cded-4b5e-a2f2-975c300e1894 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:47.191630 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-925d38ec-cded-4b5e-a2f2-975c300e1894 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 35145 microversion: 2.20 time: 0.149992 May 25 15:46:47.192823 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 429/876] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:47 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 35145 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:46:47.315148 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-861713b7-1c7c-4839-8b2f-e9be33c2da3e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "POST /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398133 May 25 15:46:47.315757 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 448/877] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:46:46 2021] POST /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:46:47.990212 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-98b8a4e7-7ab2-4f93-ba77-3994c36cb254 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:47.991316 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-98b8a4e7-7ab2-4f93-ba77-3994c36cb254 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:47.999177 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-98b8a4e7-7ab2-4f93-ba77-3994c36cb254 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:47.999629 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-98b8a4e7-7ab2-4f93-ba77-3994c36cb254 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:48.000431 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-98b8a4e7-7ab2-4f93-ba77-3994c36cb254 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:48.000864 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-98b8a4e7-7ab2-4f93-ba77-3994c36cb254 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:48.119232 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-98b8a4e7-7ab2-4f93-ba77-3994c36cb254 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28157 microversion: 2.1 time: 0.133042 May 25 15:46:48.119795 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 430/878] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:47 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28157 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:48.203631 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8fe9b121-b3c9-453d-9d92-ff582613f589 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:48.204770 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8fe9b121-b3c9-453d-9d92-ff582613f589 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:48.214016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8fe9b121-b3c9-453d-9d92-ff582613f589 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:48.214485 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8fe9b121-b3c9-453d-9d92-ff582613f589 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:48.215266 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8fe9b121-b3c9-453d-9d92-ff582613f589 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:48.215713 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8fe9b121-b3c9-453d-9d92-ff582613f589 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:48.346215 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8fe9b121-b3c9-453d-9d92-ff582613f589 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 35848 microversion: 2.20 time: 0.146403 May 25 15:46:48.350396 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 449/879] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:48 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 35848 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:49.131506 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-78c23284-1731-4b01-a0a7-d41199097517 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:49.132456 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-78c23284-1731-4b01-a0a7-d41199097517 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:49.140720 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-78c23284-1731-4b01-a0a7-d41199097517 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:49.141181 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-78c23284-1731-4b01-a0a7-d41199097517 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:49.141962 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-78c23284-1731-4b01-a0a7-d41199097517 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:49.142408 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-78c23284-1731-4b01-a0a7-d41199097517 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:49.253151 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-78c23284-1731-4b01-a0a7-d41199097517 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28157 microversion: 2.1 time: 0.125776 May 25 15:46:49.253791 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 431/880] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:49 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28157 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:49.358683 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-003aef6c-2aaa-4c1a-9291-f71aed0eaf22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:49.359688 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-003aef6c-2aaa-4c1a-9291-f71aed0eaf22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:49.367487 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-003aef6c-2aaa-4c1a-9291-f71aed0eaf22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:49.367983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-003aef6c-2aaa-4c1a-9291-f71aed0eaf22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:49.368753 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-003aef6c-2aaa-4c1a-9291-f71aed0eaf22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:49.369188 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-003aef6c-2aaa-4c1a-9291-f71aed0eaf22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:49.508313 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-003aef6c-2aaa-4c1a-9291-f71aed0eaf22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 36864 microversion: 2.20 time: 0.153569 May 25 15:46:49.508972 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 450/881] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:49 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 36864 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:50.265096 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e69ef188-7b14-4328-8e48-5dd6add94398 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:50.266134 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e69ef188-7b14-4328-8e48-5dd6add94398 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:50.274011 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e69ef188-7b14-4328-8e48-5dd6add94398 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:50.274473 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e69ef188-7b14-4328-8e48-5dd6add94398 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:50.275249 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e69ef188-7b14-4328-8e48-5dd6add94398 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:50.275687 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e69ef188-7b14-4328-8e48-5dd6add94398 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:50.393052 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e69ef188-7b14-4328-8e48-5dd6add94398 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28157 microversion: 2.1 time: 0.132253 May 25 15:46:50.393682 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 432/882] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:50 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28157 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:50.521183 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8f42ab5e-1359-492f-8896-891d7962eb27 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:50.522120 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8f42ab5e-1359-492f-8896-891d7962eb27 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:50.530552 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f42ab5e-1359-492f-8896-891d7962eb27 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:50.531006 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f42ab5e-1359-492f-8896-891d7962eb27 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:50.531783 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f42ab5e-1359-492f-8896-891d7962eb27 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:50.532252 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8f42ab5e-1359-492f-8896-891d7962eb27 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:50.650646 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8f42ab5e-1359-492f-8896-891d7962eb27 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 37801 microversion: 2.20 time: 0.133451 May 25 15:46:50.655158 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 451/883] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:50 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 37801 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:51.182897 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8e5189bf-9444-4420-8805-66570b1bdf78 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:51.183429 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8e5189bf-9444-4420-8805-66570b1bdf78 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:51.191339 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8e5189bf-9444-4420-8805-66570b1bdf78 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:51.191803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8e5189bf-9444-4420-8805-66570b1bdf78 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:51.192618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8e5189bf-9444-4420-8805-66570b1bdf78 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:51.193064 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8e5189bf-9444-4420-8805-66570b1bdf78 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:51.252890 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8e5189bf-9444-4420-8805-66570b1bdf78 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Going to try to terminate instance {{(pid=112577) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:46:51.367614 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8e5189bf-9444-4420-8805-66570b1bdf78 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 204 len: 0 microversion: 2.1 time: 0.189197 May 25 15:46:51.368308 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 433/884] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:46:51 2021] DELETE /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:46:51.377191 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bd94fb8f-70b8-4c86-b403-811e878a5141 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:51.378000 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bd94fb8f-70b8-4c86-b403-811e878a5141 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:51.386112 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd94fb8f-70b8-4c86-b403-811e878a5141 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:51.386566 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd94fb8f-70b8-4c86-b403-811e878a5141 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:51.387338 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd94fb8f-70b8-4c86-b403-811e878a5141 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:51.387773 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd94fb8f-70b8-4c86-b403-811e878a5141 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:51.405661 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d848be13-1336-4d86-b302-5d7939bd222e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:51.406673 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d848be13-1336-4d86-b302-5d7939bd222e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:51.414030 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d848be13-1336-4d86-b302-5d7939bd222e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:51.415071 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d848be13-1336-4d86-b302-5d7939bd222e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:51.415854 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d848be13-1336-4d86-b302-5d7939bd222e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:51.416323 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d848be13-1336-4d86-b302-5d7939bd222e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:51.531609 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d848be13-1336-4d86-b302-5d7939bd222e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28282 microversion: 2.1 time: 0.129918 May 25 15:46:51.535616 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 434/885] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:51 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28282 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:46:51.587390 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-bd94fb8f-70b8-4c86-b403-811e878a5141 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:51.595803 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bd94fb8f-70b8-4c86-b403-811e878a5141 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1577 microversion: 2.1 time: 0.222795 May 25 15:46:51.596398 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 452/886] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:51 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1577 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:51.663169 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-13cb6162-2994-4b52-ae87-79ff3bf19207 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:51.664211 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-13cb6162-2994-4b52-ae87-79ff3bf19207 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:51.672117 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-13cb6162-2994-4b52-ae87-79ff3bf19207 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:51.672581 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-13cb6162-2994-4b52-ae87-79ff3bf19207 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:51.673359 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-13cb6162-2994-4b52-ae87-79ff3bf19207 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:51.673803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-13cb6162-2994-4b52-ae87-79ff3bf19207 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:51.796253 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-13cb6162-2994-4b52-ae87-79ff3bf19207 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 38253 microversion: 2.20 time: 0.137035 May 25 15:46:51.796942 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 435/887] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:51 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 38253 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:52.543790 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b21e4093-959f-4409-a6ee-b0b02fe7872f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:52.544755 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b21e4093-959f-4409-a6ee-b0b02fe7872f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:52.552442 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b21e4093-959f-4409-a6ee-b0b02fe7872f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:52.552907 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b21e4093-959f-4409-a6ee-b0b02fe7872f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:52.553689 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b21e4093-959f-4409-a6ee-b0b02fe7872f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:52.554141 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b21e4093-959f-4409-a6ee-b0b02fe7872f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:52.614402 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f637d1d0-c3be-4564-87ac-8e40939995a4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:52.615123 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f637d1d0-c3be-4564-87ac-8e40939995a4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:52.623793 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f637d1d0-c3be-4564-87ac-8e40939995a4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:52.624290 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f637d1d0-c3be-4564-87ac-8e40939995a4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:52.625080 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f637d1d0-c3be-4564-87ac-8e40939995a4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:52.625530 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f637d1d0-c3be-4564-87ac-8e40939995a4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:52.668367 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b21e4093-959f-4409-a6ee-b0b02fe7872f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28448 microversion: 2.1 time: 0.128076 May 25 15:46:52.673823 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 453/888] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:52 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28448 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:52.810260 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f4dc81d2-1cf1-4db1-bfa3-27d9bdfc191f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:52.811580 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f4dc81d2-1cf1-4db1-bfa3-27d9bdfc191f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:52.820349 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f4dc81d2-1cf1-4db1-bfa3-27d9bdfc191f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:52.821273 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f4dc81d2-1cf1-4db1-bfa3-27d9bdfc191f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:52.822081 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f4dc81d2-1cf1-4db1-bfa3-27d9bdfc191f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:52.822525 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f4dc81d2-1cf1-4db1-bfa3-27d9bdfc191f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:52.823549 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f637d1d0-c3be-4564-87ac-8e40939995a4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:52.832223 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f637d1d0-c3be-4564-87ac-8e40939995a4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1577 microversion: 2.1 time: 0.221919 May 25 15:46:52.832989 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 436/889] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:52 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:52.934647 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f4dc81d2-1cf1-4db1-bfa3-27d9bdfc191f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 38253 microversion: 2.20 time: 0.129937 May 25 15:46:52.935289 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 454/890] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:52 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 38253 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 25 15:46:53.682481 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1bb103ff-a53e-4d3d-ab9f-f4e3a656bd31 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:53.683331 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1bb103ff-a53e-4d3d-ab9f-f4e3a656bd31 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:53.691302 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1bb103ff-a53e-4d3d-ab9f-f4e3a656bd31 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:53.691763 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1bb103ff-a53e-4d3d-ab9f-f4e3a656bd31 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:53.692591 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1bb103ff-a53e-4d3d-ab9f-f4e3a656bd31 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:53.693032 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1bb103ff-a53e-4d3d-ab9f-f4e3a656bd31 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:53.821842 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1bb103ff-a53e-4d3d-ab9f-f4e3a656bd31 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28535 microversion: 2.1 time: 0.143657 May 25 15:46:53.823351 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 437/891] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:53 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28535 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:53.849964 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1c6d7cf6-f2f2-470f-b556-91560a4c8ea0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:53.850682 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1c6d7cf6-f2f2-470f-b556-91560a4c8ea0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:53.858985 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1c6d7cf6-f2f2-470f-b556-91560a4c8ea0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:53.859447 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1c6d7cf6-f2f2-470f-b556-91560a4c8ea0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:53.860261 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1c6d7cf6-f2f2-470f-b556-91560a4c8ea0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:53.860704 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1c6d7cf6-f2f2-470f-b556-91560a4c8ea0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:53.946720 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-01a9d995-96dd-41ff-98bc-67e08f4f4de1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:53.952347 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-01a9d995-96dd-41ff-98bc-67e08f4f4de1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:53.969040 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-01a9d995-96dd-41ff-98bc-67e08f4f4de1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:53.969502 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-01a9d995-96dd-41ff-98bc-67e08f4f4de1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:53.970283 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-01a9d995-96dd-41ff-98bc-67e08f4f4de1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:53.970720 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-01a9d995-96dd-41ff-98bc-67e08f4f4de1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:54.100080 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1c6d7cf6-f2f2-470f-b556-91560a4c8ea0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:54.109267 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1c6d7cf6-f2f2-470f-b556-91560a4c8ea0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1577 microversion: 2.1 time: 0.263488 May 25 15:46:54.110087 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 455/892] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:53 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1577 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:54.112420 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-01a9d995-96dd-41ff-98bc-67e08f4f4de1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 200 len: 38394 microversion: 2.20 time: 0.169589 May 25 15:46:54.113883 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 438/893] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:46:53 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 38394 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 25 15:46:54.123302 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2aee5073-ad86-4975-a69a-52c806945168 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:54.123916 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2aee5073-ad86-4975-a69a-52c806945168 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:54.131356 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2aee5073-ad86-4975-a69a-52c806945168 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:54.131940 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2aee5073-ad86-4975-a69a-52c806945168 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:54.133451 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2aee5073-ad86-4975-a69a-52c806945168 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:54.135851 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2aee5073-ad86-4975-a69a-52c806945168 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:54.197876 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2aee5073-ad86-4975-a69a-52c806945168 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/ips" status: 200 len: 151 microversion: 2.20 time: 0.078071 May 25 15:46:54.198366 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 456/894] 10.222.0.36 () {60 vars in 1289 bytes} [Tue May 25 15:46:54 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/ips => generated 151 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:54.834475 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a35fa93d-3e2c-4674-b969-e08f803c7876 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:54.835691 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a35fa93d-3e2c-4674-b969-e08f803c7876 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:54.844209 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a35fa93d-3e2c-4674-b969-e08f803c7876 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:54.844675 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a35fa93d-3e2c-4674-b969-e08f803c7876 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:54.845516 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a35fa93d-3e2c-4674-b969-e08f803c7876 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:54.845964 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a35fa93d-3e2c-4674-b969-e08f803c7876 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:54.966231 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a35fa93d-3e2c-4674-b969-e08f803c7876 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28616 microversion: 2.1 time: 0.135721 May 25 15:46:54.966905 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 439/895] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:54 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28616 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:55.126685 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-17c105aa-95b1-4a82-9019-58a70ab1f437 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:55.127836 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-17c105aa-95b1-4a82-9019-58a70ab1f437 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:55.137252 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-17c105aa-95b1-4a82-9019-58a70ab1f437 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:55.137962 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-17c105aa-95b1-4a82-9019-58a70ab1f437 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:55.139181 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-17c105aa-95b1-4a82-9019-58a70ab1f437 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:55.139777 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-17c105aa-95b1-4a82-9019-58a70ab1f437 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:55.142474 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-e73e598f-8239-4d95-bb1f-df6aa1d3d75a req-751fcd29-fd29-4afa-b717-4f4dd7913543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd52975-28c3-4fb7-ada2-905a8a9c571f", "name": "network-vif-deleted", "tag": "746ae7a8-06cf-478c-b6d4-ecf4e9c02988"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:55.144322 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:46:55.144322 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:46:55.155894 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-e73e598f-8239-4d95-bb1f-df6aa1d3d75a req-751fcd29-fd29-4afa-b717-4f4dd7913543 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:55.156481 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-e73e598f-8239-4d95-bb1f-df6aa1d3d75a req-751fcd29-fd29-4afa-b717-4f4dd7913543 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:55.229821 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-e73e598f-8239-4d95-bb1f-df6aa1d3d75a req-751fcd29-fd29-4afa-b717-4f4dd7913543 service nova] Creating event network-vif-deleted:746ae7a8-06cf-478c-b6d4-ecf4e9c02988 for instance 4cd52975-28c3-4fb7-ada2-905a8a9c571f on hv-cinder-79123 May 25 15:46:55.235014 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-e73e598f-8239-4d95-bb1f-df6aa1d3d75a req-751fcd29-fd29-4afa-b717-4f4dd7913543 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098189 May 25 15:46:55.235958 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 440/896] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:46:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:46:55.275336 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-17c105aa-95b1-4a82-9019-58a70ab1f437 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:55.285900 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-17c105aa-95b1-4a82-9019-58a70ab1f437 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1509 microversion: 2.1 time: 0.163037 May 25 15:46:55.286907 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 457/897] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:55 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:46:55.978806 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6c7d231a-6d69-4fe5-b55a-718fe4b58723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:46:55.979808 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6c7d231a-6d69-4fe5-b55a-718fe4b58723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:55.987260 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c7d231a-6d69-4fe5-b55a-718fe4b58723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:55.987710 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c7d231a-6d69-4fe5-b55a-718fe4b58723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:55.988518 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c7d231a-6d69-4fe5-b55a-718fe4b58723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:55.988954 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6c7d231a-6d69-4fe5-b55a-718fe4b58723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:56.302402 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2d5509e6-fead-47a7-9b95-c77f7b471838 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:56.303128 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2d5509e6-fead-47a7-9b95-c77f7b471838 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:56.311200 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2d5509e6-fead-47a7-9b95-c77f7b471838 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:56.311665 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2d5509e6-fead-47a7-9b95-c77f7b471838 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:56.312493 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2d5509e6-fead-47a7-9b95-c77f7b471838 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:56.312942 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2d5509e6-fead-47a7-9b95-c77f7b471838 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:56.388016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2d5509e6-fead-47a7-9b95-c77f7b471838 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:56.388471 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2d5509e6-fead-47a7-9b95-c77f7b471838 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:56.389179 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-2d5509e6-fead-47a7-9b95-c77f7b471838 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lazy-loading 'fault' on Instance uuid 4cd52975-28c3-4fb7-ada2-905a8a9c571f {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:46:56.448518 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2d5509e6-fead-47a7-9b95-c77f7b471838 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:56.456973 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2d5509e6-fead-47a7-9b95-c77f7b471838 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1230 microversion: 2.1 time: 0.158280 May 25 15:46:56.457540 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 458/898] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:56 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1230 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:57.474159 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4cd385b0-3a1f-41b9-9293-37870b43da0a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:57.474826 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4cd385b0-3a1f-41b9-9293-37870b43da0a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:57.482568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cd385b0-3a1f-41b9-9293-37870b43da0a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:57.483031 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cd385b0-3a1f-41b9-9293-37870b43da0a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:57.483811 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cd385b0-3a1f-41b9-9293-37870b43da0a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:57.484288 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cd385b0-3a1f-41b9-9293-37870b43da0a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:57.550859 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cd385b0-3a1f-41b9-9293-37870b43da0a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:57.551317 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4cd385b0-3a1f-41b9-9293-37870b43da0a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:57.551776 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-4cd385b0-3a1f-41b9-9293-37870b43da0a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lazy-loading 'fault' on Instance uuid 4cd52975-28c3-4fb7-ada2-905a8a9c571f {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:46:57.609270 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4cd385b0-3a1f-41b9-9293-37870b43da0a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:57.618290 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4cd385b0-3a1f-41b9-9293-37870b43da0a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1230 microversion: 2.1 time: 0.147075 May 25 15:46:57.618850 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 459/899] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:57 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1230 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:58.634929 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8b81beeb-d0ae-43a2-a0a6-51aa24f2ed19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:58.635579 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8b81beeb-d0ae-43a2-a0a6-51aa24f2ed19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:58.643147 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b81beeb-d0ae-43a2-a0a6-51aa24f2ed19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:58.643646 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b81beeb-d0ae-43a2-a0a6-51aa24f2ed19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:58.644471 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b81beeb-d0ae-43a2-a0a6-51aa24f2ed19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:58.644910 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b81beeb-d0ae-43a2-a0a6-51aa24f2ed19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:58.711758 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b81beeb-d0ae-43a2-a0a6-51aa24f2ed19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:58.712235 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8b81beeb-d0ae-43a2-a0a6-51aa24f2ed19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:58.712687 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-8b81beeb-d0ae-43a2-a0a6-51aa24f2ed19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lazy-loading 'fault' on Instance uuid 4cd52975-28c3-4fb7-ada2-905a8a9c571f {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:46:58.768391 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-8b81beeb-d0ae-43a2-a0a6-51aa24f2ed19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:58.776595 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8b81beeb-d0ae-43a2-a0a6-51aa24f2ed19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1230 microversion: 2.1 time: 0.146005 May 25 15:46:58.777165 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 460/900] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:58 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1230 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:46:59.768650 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6c7d231a-6d69-4fe5-b55a-718fe4b58723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28616 microversion: 2.1 time: 3.793727 May 25 15:46:59.769997 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 441/901] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:46:55 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28616 bytes in 3796 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:46:59.792759 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-329c4a07-c64c-41e2-ac6c-9e9718279a45 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:46:59.793391 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-329c4a07-c64c-41e2-ac6c-9e9718279a45 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:46:59.800686 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-329c4a07-c64c-41e2-ac6c-9e9718279a45 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:59.801152 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-329c4a07-c64c-41e2-ac6c-9e9718279a45 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:59.801942 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-329c4a07-c64c-41e2-ac6c-9e9718279a45 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:59.802391 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-329c4a07-c64c-41e2-ac6c-9e9718279a45 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:59.874399 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-329c4a07-c64c-41e2-ac6c-9e9718279a45 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:59.874854 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-329c4a07-c64c-41e2-ac6c-9e9718279a45 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:59.875316 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-329c4a07-c64c-41e2-ac6c-9e9718279a45 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lazy-loading 'fault' on Instance uuid 4cd52975-28c3-4fb7-ada2-905a8a9c571f {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:46:59.935199 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-329c4a07-c64c-41e2-ac6c-9e9718279a45 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:46:59.943756 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-329c4a07-c64c-41e2-ac6c-9e9718279a45 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 200 len: 1230 microversion: 2.1 time: 0.154667 May 25 15:46:59.944371 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 461/902] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:46:59 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 1230 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:00.153835 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:00.154463 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:00.162885 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:00.163345 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:00.164925 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:00.165391 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:00.227149 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.objects.instance [None req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lazy-loading 'flavor' on Instance uuid c657feea-6b2e-48ce-a311-464e6b956e0e {{(pid=112577) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:47:00.548287 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 202 len: 0 microversion: 2.20 time: 0.399374 May 25 15:47:00.548919 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 442/903] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:47:00 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 25 15:47:00.556991 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:00.557649 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:00.564987 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:00.565509 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:00.566293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:00.566732 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:00.762722 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:00.771824 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:00.773955 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:00.775127 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.221962 May 25 15:47:00.776007 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 462/904] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:00 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:00.781351 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dea134a6-24cd-4750-bbd0-ccd11d213723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:00.782375 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-dea134a6-24cd-4750-bbd0-ccd11d213723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:00.789920 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dea134a6-24cd-4750-bbd0-ccd11d213723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:00.790380 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dea134a6-24cd-4750-bbd0-ccd11d213723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:00.791165 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dea134a6-24cd-4750-bbd0-ccd11d213723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:00.791609 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dea134a6-24cd-4750-bbd0-ccd11d213723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:00.921292 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dea134a6-24cd-4750-bbd0-ccd11d213723 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28616 microversion: 2.1 time: 0.143857 May 25 15:47:00.926084 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 443/905] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:00 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28616 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:47:00.961434 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-85cbb376-be19-4260-9add-71c363ae2084 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:00.962704 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-85cbb376-be19-4260-9add-71c363ae2084 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:00.970986 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85cbb376-be19-4260-9add-71c363ae2084 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:00.971444 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85cbb376-be19-4260-9add-71c363ae2084 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:00.972281 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85cbb376-be19-4260-9add-71c363ae2084 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:00.972724 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85cbb376-be19-4260-9add-71c363ae2084 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:01.024536 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-85cbb376-be19-4260-9add-71c363ae2084 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] HTTP exception thrown: Instance 4cd52975-28c3-4fb7-ada2-905a8a9c571f could not be found. May 25 15:47:01.025098 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-85cbb376-be19-4260-9add-71c363ae2084 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Returning 404 to user: Instance 4cd52975-28c3-4fb7-ada2-905a8a9c571f could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:47:01.025945 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-85cbb376-be19-4260-9add-71c363ae2084 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 404 len: 111 microversion: 2.1 time: 0.069543 May 25 15:47:01.026493 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 463/906] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:00 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:47:01.129977 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1417587787", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-980388926", "security_groups": [{"name": "tempest-secgroup-smoke-1147553235"}], "block_device_mapping_v2": [{"uuid": "98e8b9cb-fbe2-42aa-a04d-b39c00c671eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d8a04926-b628-40fa-a53b-51df7783813d"}]}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:01.285079 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] validate_networks() for [('d8a04926-b628-40fa-a53b-51df7783813d', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:47:01.794181 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-27aba94e-7aea-4018-87d5-ceeedc41d612 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:01.794916 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-27aba94e-7aea-4018-87d5-ceeedc41d612 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:01.802631 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-27aba94e-7aea-4018-87d5-ceeedc41d612 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:01.803036 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-27aba94e-7aea-4018-87d5-ceeedc41d612 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:01.803819 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-27aba94e-7aea-4018-87d5-ceeedc41d612 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:01.804425 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-27aba94e-7aea-4018-87d5-ceeedc41d612 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:01.822381 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:47:01.822870 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:47:01.823283 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:47:01.823813 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:47:01.824263 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:47:01.832869 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:01.833325 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:01.834134 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:01.834575 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:01.853516 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Getting quotas for project 8dff1003ceba47f6a75b4c3901343b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:47:01.858010 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Getting quotas for user 082a0ad3211940cda30d219bb251e2fe and project 8dff1003ceba47f6a75b4c3901343b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:47:01.956957 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:47:01.959190 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98e8b9cb-fbe2-42aa-a04d-b39c00c671eb',volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:47:02.011627 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-27aba94e-7aea-4018-87d5-ceeedc41d612 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:02.026767 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-27aba94e-7aea-4018-87d5-ceeedc41d612 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:02.028329 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-27aba94e-7aea-4018-87d5-ceeedc41d612 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:02.029655 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-27aba94e-7aea-4018-87d5-ceeedc41d612 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.239299 May 25 15:47:02.030210 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 464/907] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:01 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:02.034622 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-da0f9287-00dd-4d66-b084-d53da3807697 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:02.035641 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-da0f9287-00dd-4d66-b084-d53da3807697 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:02.044491 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-da0f9287-00dd-4d66-b084-d53da3807697 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:02.045089 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-da0f9287-00dd-4d66-b084-d53da3807697 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:02.046142 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-da0f9287-00dd-4d66-b084-d53da3807697 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:02.046590 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-da0f9287-00dd-4d66-b084-d53da3807697 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:02.137727 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-85a708b1-90cd-449c-9df4-011e26b28706 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.011908 May 25 15:47:02.138374 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 444/908] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:47:01 2021] POST /compute/v2.1/servers => generated 406 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:47:02.150023 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-abadc807-089f-4144-bf3f-512bab7eb45d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:02.150702 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-abadc807-089f-4144-bf3f-512bab7eb45d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:02.225123 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-abadc807-089f-4144-bf3f-512bab7eb45d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:02.235355 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-abadc807-089f-4144-bf3f-512bab7eb45d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1094 microversion: 2.1 time: 0.090522 May 25 15:47:02.235962 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 445/909] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:02 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:03.048294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4c19b678-ed05-4c96-9d08-0cff64255b29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:03.049106 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4c19b678-ed05-4c96-9d08-0cff64255b29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:03.057128 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4c19b678-ed05-4c96-9d08-0cff64255b29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:03.057592 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4c19b678-ed05-4c96-9d08-0cff64255b29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:03.058386 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4c19b678-ed05-4c96-9d08-0cff64255b29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:03.058831 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4c19b678-ed05-4c96-9d08-0cff64255b29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:03.251142 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4c19b678-ed05-4c96-9d08-0cff64255b29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:03.259717 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4c19b678-ed05-4c96-9d08-0cff64255b29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:03.261331 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4c19b678-ed05-4c96-9d08-0cff64255b29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:03.262461 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4c19b678-ed05-4c96-9d08-0cff64255b29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.217979 May 25 15:47:03.263013 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 446/910] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:03 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:03.267393 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8d35b825-68c5-41e4-ac91-f7a19a8f4f9c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:03.268028 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8d35b825-68c5-41e4-ac91-f7a19a8f4f9c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:03.275370 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8d35b825-68c5-41e4-ac91-f7a19a8f4f9c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:03.275760 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8d35b825-68c5-41e4-ac91-f7a19a8f4f9c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:03.276569 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8d35b825-68c5-41e4-ac91-f7a19a8f4f9c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:03.277006 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8d35b825-68c5-41e4-ac91-f7a19a8f4f9c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:03.389417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-8d35b825-68c5-41e4-ac91-f7a19a8f4f9c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:03.397579 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8d35b825-68c5-41e4-ac91-f7a19a8f4f9c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1144 microversion: 2.1 time: 0.133620 May 25 15:47:03.398158 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 447/911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:03 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1144 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:04.279705 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:04.280362 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:04.288023 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:04.288472 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:04.289238 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:04.289674 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:04.489273 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:04.498673 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:04.500199 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:04.501328 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.225374 May 25 15:47:04.501889 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 448/912] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:04 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:04.506033 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-271500c2-3762-413c-9101-884405113ced tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:04.506642 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-271500c2-3762-413c-9101-884405113ced tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:04.513480 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-271500c2-3762-413c-9101-884405113ced tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:04.514204 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-271500c2-3762-413c-9101-884405113ced tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:04.514969 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-271500c2-3762-413c-9101-884405113ced tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:04.515412 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-271500c2-3762-413c-9101-884405113ced tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:04.625074 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-271500c2-3762-413c-9101-884405113ced tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:04.633100 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-271500c2-3762-413c-9101-884405113ced tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1144 microversion: 2.1 time: 0.130265 May 25 15:47:04.633670 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 449/913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:04 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1144 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:05.042044 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-da0f9287-00dd-4d66-b084-d53da3807697 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28616 microversion: 2.1 time: 3.010550 May 25 15:47:05.042709 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 465/914] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:02 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28616 bytes in 3012 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:47:05.519550 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:05.520250 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:05.528273 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:05.528724 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:05.529503 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:05.529946 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:05.650848 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ef62e420-20a3-4af2-8399-3981cafc920f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:05.651557 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ef62e420-20a3-4af2-8399-3981cafc920f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:05.659346 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef62e420-20a3-4af2-8399-3981cafc920f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:05.659814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef62e420-20a3-4af2-8399-3981cafc920f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:05.660611 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef62e420-20a3-4af2-8399-3981cafc920f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:05.661048 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef62e420-20a3-4af2-8399-3981cafc920f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:05.733115 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:05.742073 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:05.743595 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:05.744807 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.229342 May 25 15:47:05.745369 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 450/915] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:05 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:05.773587 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ef62e420-20a3-4af2-8399-3981cafc920f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:05.783158 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ef62e420-20a3-4af2-8399-3981cafc920f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1192 microversion: 2.1 time: 0.136935 May 25 15:47:05.783736 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 466/916] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:05 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1192 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:06.053573 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fcb81069-8e81-4084-9118-9b2e6b3f734f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:06.054622 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fcb81069-8e81-4084-9118-9b2e6b3f734f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:06.061975 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fcb81069-8e81-4084-9118-9b2e6b3f734f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:06.062598 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fcb81069-8e81-4084-9118-9b2e6b3f734f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:06.063461 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fcb81069-8e81-4084-9118-9b2e6b3f734f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:06.064010 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fcb81069-8e81-4084-9118-9b2e6b3f734f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:06.200595 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fcb81069-8e81-4084-9118-9b2e6b3f734f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28616 microversion: 2.1 time: 0.150626 May 25 15:47:06.202748 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 451/917] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:06 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28616 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:47:06.763653 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1464028c-fb82-4e29-9107-90d3a72cbcc0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:06.765341 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1464028c-fb82-4e29-9107-90d3a72cbcc0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:06.773571 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1464028c-fb82-4e29-9107-90d3a72cbcc0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:06.774025 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1464028c-fb82-4e29-9107-90d3a72cbcc0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:06.774803 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1464028c-fb82-4e29-9107-90d3a72cbcc0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:06.775241 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1464028c-fb82-4e29-9107-90d3a72cbcc0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:06.801856 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1777a09f-20ea-4735-9acb-1a9d1918cade tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:06.802625 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1777a09f-20ea-4735-9acb-1a9d1918cade tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:06.813379 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1777a09f-20ea-4735-9acb-1a9d1918cade tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:06.814284 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1777a09f-20ea-4735-9acb-1a9d1918cade tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:06.816048 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1777a09f-20ea-4735-9acb-1a9d1918cade tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:06.816633 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1777a09f-20ea-4735-9acb-1a9d1918cade tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:06.992063 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1464028c-fb82-4e29-9107-90d3a72cbcc0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:07.001680 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1464028c-fb82-4e29-9107-90d3a72cbcc0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:07.003346 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1464028c-fb82-4e29-9107-90d3a72cbcc0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:07.004721 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1464028c-fb82-4e29-9107-90d3a72cbcc0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.245733 May 25 15:47:07.005385 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 467/918] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:06 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:07.104883 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1777a09f-20ea-4735-9acb-1a9d1918cade tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:07.113841 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1777a09f-20ea-4735-9acb-1a9d1918cade tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1278 microversion: 2.1 time: 0.316839 May 25 15:47:07.114417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 452/919] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:06 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1278 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:07.212461 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c6ea77dc-4b6f-428c-8a63-a561e4a7d13f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:07.213392 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c6ea77dc-4b6f-428c-8a63-a561e4a7d13f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:07.220692 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c6ea77dc-4b6f-428c-8a63-a561e4a7d13f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:07.221151 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c6ea77dc-4b6f-428c-8a63-a561e4a7d13f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:07.221930 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c6ea77dc-4b6f-428c-8a63-a561e4a7d13f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:07.222371 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c6ea77dc-4b6f-428c-8a63-a561e4a7d13f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:08.023322 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-14797394-125d-439b-9306-6e60eef7f911 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:08.023977 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-14797394-125d-439b-9306-6e60eef7f911 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:08.031691 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-14797394-125d-439b-9306-6e60eef7f911 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:08.032194 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-14797394-125d-439b-9306-6e60eef7f911 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:08.032976 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-14797394-125d-439b-9306-6e60eef7f911 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:08.033426 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-14797394-125d-439b-9306-6e60eef7f911 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:08.230101 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-14797394-125d-439b-9306-6e60eef7f911 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:08.238774 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-14797394-125d-439b-9306-6e60eef7f911 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:08.240343 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-14797394-125d-439b-9306-6e60eef7f911 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:08.241475 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-14797394-125d-439b-9306-6e60eef7f911 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.222052 May 25 15:47:08.242029 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 453/920] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:08 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:08.246814 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-120cdbbd-63e2-4ae1-b006-ddc9a093638f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:08.247424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-120cdbbd-63e2-4ae1-b006-ddc9a093638f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:08.254249 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-120cdbbd-63e2-4ae1-b006-ddc9a093638f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:08.254701 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-120cdbbd-63e2-4ae1-b006-ddc9a093638f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:08.255468 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-120cdbbd-63e2-4ae1-b006-ddc9a093638f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:08.255935 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-120cdbbd-63e2-4ae1-b006-ddc9a093638f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:08.455894 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-120cdbbd-63e2-4ae1-b006-ddc9a093638f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:08.464610 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-120cdbbd-63e2-4ae1-b006-ddc9a093638f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1278 microversion: 2.1 time: 0.221638 May 25 15:47:08.465184 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 454/921] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:08 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:09.260792 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-950e2083-82bf-4c7e-8031-9090d03456c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:09.261481 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-950e2083-82bf-4c7e-8031-9090d03456c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:09.268972 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-950e2083-82bf-4c7e-8031-9090d03456c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:09.269427 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-950e2083-82bf-4c7e-8031-9090d03456c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:09.270202 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-950e2083-82bf-4c7e-8031-9090d03456c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:09.270645 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-950e2083-82bf-4c7e-8031-9090d03456c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:09.470556 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-950e2083-82bf-4c7e-8031-9090d03456c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:09.479243 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-950e2083-82bf-4c7e-8031-9090d03456c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:09.480812 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-950e2083-82bf-4c7e-8031-9090d03456c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:09.481959 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-950e2083-82bf-4c7e-8031-9090d03456c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.225696 May 25 15:47:09.482526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 455/922] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:09 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:09.486712 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dfba457a-5602-47ba-accd-1c0d55ffcead tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:09.487329 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-dfba457a-5602-47ba-accd-1c0d55ffcead tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:09.494727 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dfba457a-5602-47ba-accd-1c0d55ffcead tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:09.495194 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dfba457a-5602-47ba-accd-1c0d55ffcead tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:09.496007 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dfba457a-5602-47ba-accd-1c0d55ffcead tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:09.496459 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dfba457a-5602-47ba-accd-1c0d55ffcead tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:09.692579 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-dfba457a-5602-47ba-accd-1c0d55ffcead tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:09.700805 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dfba457a-5602-47ba-accd-1c0d55ffcead tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1278 microversion: 2.1 time: 0.217324 May 25 15:47:09.701385 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 456/923] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:09 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1278 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:10.168449 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c6ea77dc-4b6f-428c-8a63-a561e4a7d13f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28616 microversion: 2.1 time: 2.959975 May 25 15:47:10.169108 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 468/924] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:07 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28616 bytes in 2962 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:47:10.501389 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:10.501389 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:10.508386 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:10.508846 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:10.509630 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:10.510073 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:10.717919 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-11903f6c-00bb-43ea-9cc8-7e3ed101293c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:10.718805 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-11903f6c-00bb-43ea-9cc8-7e3ed101293c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:10.728314 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-11903f6c-00bb-43ea-9cc8-7e3ed101293c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:10.728903 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-11903f6c-00bb-43ea-9cc8-7e3ed101293c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:10.729961 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-11903f6c-00bb-43ea-9cc8-7e3ed101293c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:10.730461 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-11903f6c-00bb-43ea-9cc8-7e3ed101293c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:10.958830 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-11903f6c-00bb-43ea-9cc8-7e3ed101293c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:10.967979 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-11903f6c-00bb-43ea-9cc8-7e3ed101293c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1278 microversion: 2.1 time: 0.254610 May 25 15:47:10.968575 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 469/925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:10 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1278 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:11.074516 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:11.083966 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:11.085626 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:11.086949 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.590893 May 25 15:47:11.087592 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 457/926] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:10 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:11.180478 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ed185e00-fb0c-4171-9cf2-d03bc72de43a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:11.183008 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ed185e00-fb0c-4171-9cf2-d03bc72de43a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:11.190595 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed185e00-fb0c-4171-9cf2-d03bc72de43a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:11.191170 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed185e00-fb0c-4171-9cf2-d03bc72de43a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:11.192430 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed185e00-fb0c-4171-9cf2-d03bc72de43a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:11.193089 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed185e00-fb0c-4171-9cf2-d03bc72de43a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:11.275546 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-2835fc10-9e61-4162-9d8a-1ad9fda86645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872c3577-4aec-4d1b-bcba-583bdbea50cb", "tag": "241b07d8-fed4-43ac-a7e1-530b98daf731"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:11.277580 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:47:11.277580 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:47:11.288163 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-2835fc10-9e61-4162-9d8a-1ad9fda86645 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:11.288641 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-2835fc10-9e61-4162-9d8a-1ad9fda86645 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:11.306263 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-2835fc10-9e61-4162-9d8a-1ad9fda86645 service nova] Creating event network-changed:241b07d8-fed4-43ac-a7e1-530b98daf731 for instance 872c3577-4aec-4d1b-bcba-583bdbea50cb on hv-cinder-79123 May 25 15:47:11.311458 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-2835fc10-9e61-4162-9d8a-1ad9fda86645 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042125 May 25 15:47:11.312321 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 458/927] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:47:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:11.316182 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ed185e00-fb0c-4171-9cf2-d03bc72de43a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 28616 microversion: 2.1 time: 0.139427 May 25 15:47:11.319992 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 470/928] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:11 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 28616 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:47:11.986169 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c7577104-5a8c-41e2-b9a3-91baa24bff04 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:11.986996 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c7577104-5a8c-41e2-b9a3-91baa24bff04 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:11.995762 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c7577104-5a8c-41e2-b9a3-91baa24bff04 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:11.996368 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c7577104-5a8c-41e2-b9a3-91baa24bff04 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:11.997282 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c7577104-5a8c-41e2-b9a3-91baa24bff04 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:11.997821 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c7577104-5a8c-41e2-b9a3-91baa24bff04 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:12.107809 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f7ff1353-3e29-4278-93fb-2f4c34f15935 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:12.108502 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f7ff1353-3e29-4278-93fb-2f4c34f15935 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:12.117053 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f7ff1353-3e29-4278-93fb-2f4c34f15935 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:12.117522 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f7ff1353-3e29-4278-93fb-2f4c34f15935 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:12.118307 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f7ff1353-3e29-4278-93fb-2f4c34f15935 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:12.118747 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f7ff1353-3e29-4278-93fb-2f4c34f15935 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:12.327344 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f7ff1353-3e29-4278-93fb-2f4c34f15935 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:12.336497 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f7ff1353-3e29-4278-93fb-2f4c34f15935 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:12.338398 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f7ff1353-3e29-4278-93fb-2f4c34f15935 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:12.339828 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f7ff1353-3e29-4278-93fb-2f4c34f15935 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.236256 May 25 15:47:12.340636 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 471/929] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:12 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:12.346494 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-35f701b3-bb02-450d-9679-321f5695311b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:12.347432 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-35f701b3-bb02-450d-9679-321f5695311b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:12.356556 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-35f701b3-bb02-450d-9679-321f5695311b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:12.357051 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-35f701b3-bb02-450d-9679-321f5695311b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:12.357906 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-35f701b3-bb02-450d-9679-321f5695311b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:12.358298 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-35f701b3-bb02-450d-9679-321f5695311b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:12.397660 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c7577104-5a8c-41e2-b9a3-91baa24bff04 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:12.406777 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c7577104-5a8c-41e2-b9a3-91baa24bff04 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.425405 May 25 15:47:12.407450 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 459/930] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:11 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:12.476253 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-35f701b3-bb02-450d-9679-321f5695311b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 29544 microversion: 2.1 time: 0.134236 May 25 15:47:12.477723 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 472/931] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:12 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 29544 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:47:13.358241 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:13.358874 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:13.366299 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:13.366763 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:13.367578 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:13.368059 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:13.423281 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-83d28378-6186-48be-bbf3-4260cc5d7012 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:13.424030 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-83d28378-6186-48be-bbf3-4260cc5d7012 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:13.432754 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-83d28378-6186-48be-bbf3-4260cc5d7012 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:13.433226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-83d28378-6186-48be-bbf3-4260cc5d7012 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:13.434648 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-83d28378-6186-48be-bbf3-4260cc5d7012 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:13.435216 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-83d28378-6186-48be-bbf3-4260cc5d7012 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:13.638178 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-83d28378-6186-48be-bbf3-4260cc5d7012 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:13.646738 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-83d28378-6186-48be-bbf3-4260cc5d7012 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.227537 May 25 15:47:13.647315 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 473/932] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:13 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:13.652253 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-abf5f5c4-698a-46eb-aec5-e65e974e45d9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:13.653437 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-abf5f5c4-698a-46eb-aec5-e65e974e45d9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:13.660202 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-abf5f5c4-698a-46eb-aec5-e65e974e45d9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:13.660666 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-abf5f5c4-698a-46eb-aec5-e65e974e45d9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:13.661612 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-abf5f5c4-698a-46eb-aec5-e65e974e45d9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:13.662054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-abf5f5c4-698a-46eb-aec5-e65e974e45d9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:13.699961 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:13.709046 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:13.710690 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:13.711839 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.357493 May 25 15:47:13.713226 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 460/933] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:13 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:13.787980 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-abf5f5c4-698a-46eb-aec5-e65e974e45d9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 30824 microversion: 2.1 time: 0.139329 May 25 15:47:13.788660 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 474/934] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:13 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 30824 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:47:14.663911 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-17545450-3945-45c2-89c8-7f52e09c653e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:14.664530 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-17545450-3945-45c2-89c8-7f52e09c653e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:14.672275 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-17545450-3945-45c2-89c8-7f52e09c653e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:14.672728 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-17545450-3945-45c2-89c8-7f52e09c653e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:14.673526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-17545450-3945-45c2-89c8-7f52e09c653e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:14.673963 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-17545450-3945-45c2-89c8-7f52e09c653e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:14.730786 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:14.731506 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:14.739422 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:14.739983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:14.740728 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:14.741176 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:14.873140 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-17545450-3945-45c2-89c8-7f52e09c653e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:14.881784 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-17545450-3945-45c2-89c8-7f52e09c653e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.221685 May 25 15:47:14.882430 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 461/935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:14 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:14.887435 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9b30ba7a-1a22-4ac6-b668-0efe8399d45a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:14.888498 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9b30ba7a-1a22-4ac6-b668-0efe8399d45a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:14.896315 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b30ba7a-1a22-4ac6-b668-0efe8399d45a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:14.896847 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b30ba7a-1a22-4ac6-b668-0efe8399d45a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:14.897719 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b30ba7a-1a22-4ac6-b668-0efe8399d45a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:14.898168 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b30ba7a-1a22-4ac6-b668-0efe8399d45a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:14.939033 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:14.947896 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:14.949627 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:14.950900 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.224311 May 25 15:47:14.951552 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 475/936] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:14 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:15.001232 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9b30ba7a-1a22-4ac6-b668-0efe8399d45a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 31974 microversion: 2.1 time: 0.117326 May 25 15:47:15.001864 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 462/937] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:14 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 31974 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:47:15.152704 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f4d73aca-fd31-4ea5-9b2d-b32e56546458 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:15.153218 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f4d73aca-fd31-4ea5-9b2d-b32e56546458 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:15.160407 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f4d73aca-fd31-4ea5-9b2d-b32e56546458 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:15.160876 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f4d73aca-fd31-4ea5-9b2d-b32e56546458 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:15.161650 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f4d73aca-fd31-4ea5-9b2d-b32e56546458 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:15.162094 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f4d73aca-fd31-4ea5-9b2d-b32e56546458 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:15.326524 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-f4d73aca-fd31-4ea5-9b2d-b32e56546458 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lazy-loading 'services' on Instance uuid 7712bac3-f186-45b0-bf23-cd5e6c4b4664 {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:47:15.464794 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f4d73aca-fd31-4ea5-9b2d-b32e56546458 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664/os-volume_attachments/8ed1f743-0cdc-4739-b290-1c87b2d795d2" status: 202 len: 0 microversion: 2.1 time: 0.316205 May 25 15:47:15.465373 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 476/938] 10.222.0.36 () {58 vars in 1416 bytes} [Tue May 25 15:47:15 2021] DELETE /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664/os-volume_attachments/8ed1f743-0cdc-4739-b290-1c87b2d795d2 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:47:15.898710 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3de9fefa-0f49-49a4-a791-a3dcd6240a6e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:15.899531 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3de9fefa-0f49-49a4-a791-a3dcd6240a6e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:15.908624 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3de9fefa-0f49-49a4-a791-a3dcd6240a6e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:15.909083 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3de9fefa-0f49-49a4-a791-a3dcd6240a6e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:15.909862 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3de9fefa-0f49-49a4-a791-a3dcd6240a6e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:15.910302 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3de9fefa-0f49-49a4-a791-a3dcd6240a6e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:15.970446 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:15.971168 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:15.978756 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:15.979213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:15.980026 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:15.980467 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:16.129005 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3de9fefa-0f49-49a4-a791-a3dcd6240a6e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:16.138347 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3de9fefa-0f49-49a4-a791-a3dcd6240a6e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.243696 May 25 15:47:16.138927 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 463/939] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:15 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:16.143571 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0594e3fc-bf5e-45cd-b3cf-105bc970674f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:16.144497 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0594e3fc-bf5e-45cd-b3cf-105bc970674f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:16.151555 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0594e3fc-bf5e-45cd-b3cf-105bc970674f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:16.152043 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0594e3fc-bf5e-45cd-b3cf-105bc970674f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:16.152818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0594e3fc-bf5e-45cd-b3cf-105bc970674f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:16.153251 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0594e3fc-bf5e-45cd-b3cf-105bc970674f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:16.276644 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0594e3fc-bf5e-45cd-b3cf-105bc970674f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 32812 microversion: 2.1 time: 0.136129 May 25 15:47:16.277838 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 464/940] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:16 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 32812 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:47:16.347550 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:16.357054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:16.358588 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:16.359731 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.394287 May 25 15:47:16.360651 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 477/941] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:15 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:17.155691 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-19ad3e49-3bc1-48e2-b78d-3b493505b9a8 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:17.156439 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-19ad3e49-3bc1-48e2-b78d-3b493505b9a8 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:17.164523 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-19ad3e49-3bc1-48e2-b78d-3b493505b9a8 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:17.164989 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-19ad3e49-3bc1-48e2-b78d-3b493505b9a8 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:17.166267 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-19ad3e49-3bc1-48e2-b78d-3b493505b9a8 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:17.166718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-19ad3e49-3bc1-48e2-b78d-3b493505b9a8 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:17.289034 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-012eccc2-8b1d-4f68-9a34-1b614522d6bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:17.290022 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-012eccc2-8b1d-4f68-9a34-1b614522d6bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:17.297751 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-012eccc2-8b1d-4f68-9a34-1b614522d6bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:17.298216 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-012eccc2-8b1d-4f68-9a34-1b614522d6bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:17.299007 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-012eccc2-8b1d-4f68-9a34-1b614522d6bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:17.299452 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-012eccc2-8b1d-4f68-9a34-1b614522d6bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:17.367300 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-19ad3e49-3bc1-48e2-b78d-3b493505b9a8 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:17.376553 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-19ad3e49-3bc1-48e2-b78d-3b493505b9a8 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.225086 May 25 15:47:17.377132 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 465/942] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:17 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:17.381509 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c44515cd-a1a7-4537-8c75-a15efd6d6766 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:17.382119 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c44515cd-a1a7-4537-8c75-a15efd6d6766 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:17.389961 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c44515cd-a1a7-4537-8c75-a15efd6d6766 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:17.390415 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c44515cd-a1a7-4537-8c75-a15efd6d6766 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:17.391193 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c44515cd-a1a7-4537-8c75-a15efd6d6766 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:17.391641 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c44515cd-a1a7-4537-8c75-a15efd6d6766 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:17.422578 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-012eccc2-8b1d-4f68-9a34-1b614522d6bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 33469 microversion: 2.1 time: 0.136980 May 25 15:47:17.423184 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 478/943] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:17 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 33469 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:47:17.583526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c44515cd-a1a7-4537-8c75-a15efd6d6766 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:17.592193 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c44515cd-a1a7-4537-8c75-a15efd6d6766 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:17.593728 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c44515cd-a1a7-4537-8c75-a15efd6d6766 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:17.594872 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c44515cd-a1a7-4537-8c75-a15efd6d6766 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1744 microversion: 2.20 time: 0.216767 May 25 15:47:17.595436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 466/944] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:17 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:17.751656 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-158c903b-c9e1-485e-b10d-95ff78489344 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:17.752282 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-158c903b-c9e1-485e-b10d-95ff78489344 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:17.760660 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-158c903b-c9e1-485e-b10d-95ff78489344 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:17.761114 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-158c903b-c9e1-485e-b10d-95ff78489344 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:17.761883 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-158c903b-c9e1-485e-b10d-95ff78489344 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:17.762322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-158c903b-c9e1-485e-b10d-95ff78489344 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:17.824212 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-158c903b-c9e1-485e-b10d-95ff78489344 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Going to try to terminate instance {{(pid=112576) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:47:17.934361 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-158c903b-c9e1-485e-b10d-95ff78489344 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 204 len: 0 microversion: 2.1 time: 0.186308 May 25 15:47:17.935262 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 479/945] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:47:17 2021] DELETE /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:47:17.942939 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a52ab9ab-f72b-41fb-96ea-187adce9b2c6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:17.943572 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a52ab9ab-f72b-41fb-96ea-187adce9b2c6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:17.954107 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a52ab9ab-f72b-41fb-96ea-187adce9b2c6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:17.954598 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a52ab9ab-f72b-41fb-96ea-187adce9b2c6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:17.955414 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a52ab9ab-f72b-41fb-96ea-187adce9b2c6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:17.955919 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a52ab9ab-f72b-41fb-96ea-187adce9b2c6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:18.162740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a52ab9ab-f72b-41fb-96ea-187adce9b2c6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:18.172511 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a52ab9ab-f72b-41fb-96ea-187adce9b2c6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1513 microversion: 2.1 time: 0.233207 May 25 15:47:18.173094 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 467/946] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:17 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:18.394030 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-06917c24-469c-469a-ab01-d5281bdca5c5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:18.394741 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-06917c24-469c-469a-ab01-d5281bdca5c5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:18.401990 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-06917c24-469c-469a-ab01-d5281bdca5c5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:18.402522 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-06917c24-469c-469a-ab01-d5281bdca5c5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:18.403310 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-06917c24-469c-469a-ab01-d5281bdca5c5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:18.403753 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-06917c24-469c-469a-ab01-d5281bdca5c5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:18.438205 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-19fb86b5-335f-4e9f-9789-0806163325ec tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:18.440181 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-19fb86b5-335f-4e9f-9789-0806163325ec tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:18.448049 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-19fb86b5-335f-4e9f-9789-0806163325ec tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:18.448511 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-19fb86b5-335f-4e9f-9789-0806163325ec tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:18.449299 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-19fb86b5-335f-4e9f-9789-0806163325ec tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:18.450127 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-19fb86b5-335f-4e9f-9789-0806163325ec tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:18.569496 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-19fb86b5-335f-4e9f-9789-0806163325ec tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 33828 microversion: 2.1 time: 0.138629 May 25 15:47:18.573664 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 468/947] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:18 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 33828 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:47:18.601157 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-06917c24-469c-469a-ab01-d5281bdca5c5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:18.610095 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-06917c24-469c-469a-ab01-d5281bdca5c5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.220660 May 25 15:47:18.610660 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 480/948] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:18 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:18.613162 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-576dab51-e62f-4845-b326-32abe8524f77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:18.613862 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-576dab51-e62f-4845-b326-32abe8524f77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:18.622409 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-576dab51-e62f-4845-b326-32abe8524f77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:18.622861 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-576dab51-e62f-4845-b326-32abe8524f77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:18.623662 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-576dab51-e62f-4845-b326-32abe8524f77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:18.624131 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-576dab51-e62f-4845-b326-32abe8524f77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:18.816834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-576dab51-e62f-4845-b326-32abe8524f77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:18.825636 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-576dab51-e62f-4845-b326-32abe8524f77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:18.827158 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-576dab51-e62f-4845-b326-32abe8524f77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:18.828349 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-576dab51-e62f-4845-b326-32abe8524f77 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1744 microversion: 2.20 time: 0.219415 May 25 15:47:18.828909 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 469/949] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:18 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:19.189338 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4aed3023-1a9b-4fd4-b553-3748077ab40a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:19.189922 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4aed3023-1a9b-4fd4-b553-3748077ab40a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:19.197723 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4aed3023-1a9b-4fd4-b553-3748077ab40a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:19.198136 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4aed3023-1a9b-4fd4-b553-3748077ab40a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:19.199022 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4aed3023-1a9b-4fd4-b553-3748077ab40a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:19.199473 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4aed3023-1a9b-4fd4-b553-3748077ab40a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:19.490953 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4aed3023-1a9b-4fd4-b553-3748077ab40a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:19.500391 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4aed3023-1a9b-4fd4-b553-3748077ab40a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1513 microversion: 2.1 time: 0.314777 May 25 15:47:19.501168 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 481/950] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:19 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1513 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:19.581264 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e152e511-2ca3-4e48-a2a4-5e712e743c9c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:19.582334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e152e511-2ca3-4e48-a2a4-5e712e743c9c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:19.590808 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e152e511-2ca3-4e48-a2a4-5e712e743c9c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:19.591263 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e152e511-2ca3-4e48-a2a4-5e712e743c9c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:19.592096 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e152e511-2ca3-4e48-a2a4-5e712e743c9c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:19.592536 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e152e511-2ca3-4e48-a2a4-5e712e743c9c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:19.626281 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b15de1bc-ed16-4cec-aeb2-9d167c69508e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:19.626909 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b15de1bc-ed16-4cec-aeb2-9d167c69508e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:19.634280 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b15de1bc-ed16-4cec-aeb2-9d167c69508e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:19.635274 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b15de1bc-ed16-4cec-aeb2-9d167c69508e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:19.636088 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b15de1bc-ed16-4cec-aeb2-9d167c69508e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:19.636529 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b15de1bc-ed16-4cec-aeb2-9d167c69508e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:19.716394 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e152e511-2ca3-4e48-a2a4-5e712e743c9c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 34332 microversion: 2.1 time: 0.138505 May 25 15:47:19.720816 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 470/951] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:19 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 34332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:47:19.844747 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b15de1bc-ed16-4cec-aeb2-9d167c69508e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:19.849044 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-da48e864-9a0e-4175-b3c3-f7b96f0215cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:19.849774 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-da48e864-9a0e-4175-b3c3-f7b96f0215cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:19.853611 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b15de1bc-ed16-4cec-aeb2-9d167c69508e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.230839 May 25 15:47:19.854700 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 482/952] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:19 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:19.870344 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-da48e864-9a0e-4175-b3c3-f7b96f0215cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:19.870344 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-da48e864-9a0e-4175-b3c3-f7b96f0215cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:19.871027 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-da48e864-9a0e-4175-b3c3-f7b96f0215cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:19.872045 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-da48e864-9a0e-4175-b3c3-f7b96f0215cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:20.093499 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-da48e864-9a0e-4175-b3c3-f7b96f0215cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:20.103623 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-da48e864-9a0e-4175-b3c3-f7b96f0215cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:20.105375 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-da48e864-9a0e-4175-b3c3-f7b96f0215cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:20.106646 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-da48e864-9a0e-4175-b3c3-f7b96f0215cd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1739 microversion: 2.20 time: 0.263140 May 25 15:47:20.107439 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 471/953] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:19 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:20.315368 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-6c21fa1f-5d3a-40b1-8f4f-4dc7d90c3009 req-e2c8f4e0-2c43-4354-87c7-d6c632b097ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c657feea-6b2e-48ce-a311-464e6b956e0e", "name": "network-vif-plugged", "status": "completed", "tag": "8c3b5d16-b63c-438e-a031-8606d9e7796f"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:20.317075 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:47:20.317075 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:47:20.326883 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-6c21fa1f-5d3a-40b1-8f4f-4dc7d90c3009 req-e2c8f4e0-2c43-4354-87c7-d6c632b097ea service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:20.327347 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-6c21fa1f-5d3a-40b1-8f4f-4dc7d90c3009 req-e2c8f4e0-2c43-4354-87c7-d6c632b097ea service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:20.345292 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-6c21fa1f-5d3a-40b1-8f4f-4dc7d90c3009 req-e2c8f4e0-2c43-4354-87c7-d6c632b097ea service nova] Creating event network-vif-plugged:8c3b5d16-b63c-438e-a031-8606d9e7796f for instance c657feea-6b2e-48ce-a311-464e6b956e0e on hv-cinder-79123 May 25 15:47:20.365847 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-6c21fa1f-5d3a-40b1-8f4f-4dc7d90c3009 req-e2c8f4e0-2c43-4354-87c7-d6c632b097ea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054330 May 25 15:47:20.366760 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 483/954] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:47:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:20.518864 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f52ba210-2c35-4abb-a63f-21ae85e61c32 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:20.519487 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f52ba210-2c35-4abb-a63f-21ae85e61c32 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:20.526934 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f52ba210-2c35-4abb-a63f-21ae85e61c32 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:20.527740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f52ba210-2c35-4abb-a63f-21ae85e61c32 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:20.528569 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f52ba210-2c35-4abb-a63f-21ae85e61c32 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:20.529036 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f52ba210-2c35-4abb-a63f-21ae85e61c32 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:20.729161 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0a0f4bb2-ebc3-4241-bc3c-bfe34dc83e20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:20.730364 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0a0f4bb2-ebc3-4241-bc3c-bfe34dc83e20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:20.757453 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0a0f4bb2-ebc3-4241-bc3c-bfe34dc83e20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:20.768627 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0a0f4bb2-ebc3-4241-bc3c-bfe34dc83e20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:20.769754 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0a0f4bb2-ebc3-4241-bc3c-bfe34dc83e20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:20.770377 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0a0f4bb2-ebc3-4241-bc3c-bfe34dc83e20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:20.915518 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0a0f4bb2-ebc3-4241-bc3c-bfe34dc83e20 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 34983 microversion: 2.1 time: 0.190204 May 25 15:47:20.916881 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 484/955] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:20 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 34983 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:47:20.926922 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-79ee3ee4-f951-4f59-8e5c-5f2fd505c371 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:20.927787 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-79ee3ee4-f951-4f59-8e5c-5f2fd505c371 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:20.943558 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-79ee3ee4-f951-4f59-8e5c-5f2fd505c371 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:20.953007 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-79ee3ee4-f951-4f59-8e5c-5f2fd505c371 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:20.953628 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-79ee3ee4-f951-4f59-8e5c-5f2fd505c371 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:20.954081 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-79ee3ee4-f951-4f59-8e5c-5f2fd505c371 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:21.116818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f52ba210-2c35-4abb-a63f-21ae85e61c32 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:21.128741 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f52ba210-2c35-4abb-a63f-21ae85e61c32 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1513 microversion: 2.1 time: 0.613894 May 25 15:47:21.132484 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 472/956] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:20 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1513 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:21.140304 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1cbdb2ff-0052-4871-886e-de78b39afed4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:21.148717 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1cbdb2ff-0052-4871-886e-de78b39afed4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:21.170101 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1cbdb2ff-0052-4871-886e-de78b39afed4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:21.170562 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1cbdb2ff-0052-4871-886e-de78b39afed4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:21.171364 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1cbdb2ff-0052-4871-886e-de78b39afed4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:21.171807 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1cbdb2ff-0052-4871-886e-de78b39afed4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:21.306649 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-79ee3ee4-f951-4f59-8e5c-5f2fd505c371 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:21.315122 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-79ee3ee4-f951-4f59-8e5c-5f2fd505c371 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.396890 May 25 15:47:21.325379 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 485/957] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:20 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:21.676444 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1cbdb2ff-0052-4871-886e-de78b39afed4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:21.691851 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1cbdb2ff-0052-4871-886e-de78b39afed4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:21.694067 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1cbdb2ff-0052-4871-886e-de78b39afed4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:21.695590 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1cbdb2ff-0052-4871-886e-de78b39afed4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1739 microversion: 2.20 time: 0.561731 May 25 15:47:21.696389 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 473/958] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:21 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1739 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:21.861947 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-9a7ce5a5-8fe9-45a9-9fe1-5fd4ef1fee7e req-50138d98-e3c6-4caf-ac8f-65d91c177600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7712bac3-f186-45b0-bf23-cd5e6c4b4664", "name": "network-vif-deleted", "tag": "95018903-b76e-4499-90aa-6e8e90060c3c"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:21.865593 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:47:21.865593 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:47:21.883746 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-9a7ce5a5-8fe9-45a9-9fe1-5fd4ef1fee7e req-50138d98-e3c6-4caf-ac8f-65d91c177600 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:21.884295 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-9a7ce5a5-8fe9-45a9-9fe1-5fd4ef1fee7e req-50138d98-e3c6-4caf-ac8f-65d91c177600 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:21.904963 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-9a7ce5a5-8fe9-45a9-9fe1-5fd4ef1fee7e req-50138d98-e3c6-4caf-ac8f-65d91c177600 service nova] Creating event network-vif-deleted:95018903-b76e-4499-90aa-6e8e90060c3c for instance 7712bac3-f186-45b0-bf23-cd5e6c4b4664 on hv-cinder-79123 May 25 15:47:21.911055 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-9a7ce5a5-8fe9-45a9-9fe1-5fd4ef1fee7e req-50138d98-e3c6-4caf-ac8f-65d91c177600 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052731 May 25 15:47:21.911653 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 486/959] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:47:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:21.927326 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6f2f9320-0d06-41cd-ac21-6a4e7137ed44 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:21.928624 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6f2f9320-0d06-41cd-ac21-6a4e7137ed44 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:21.938296 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6f2f9320-0d06-41cd-ac21-6a4e7137ed44 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:21.939102 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6f2f9320-0d06-41cd-ac21-6a4e7137ed44 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:21.940161 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6f2f9320-0d06-41cd-ac21-6a4e7137ed44 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:21.940851 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6f2f9320-0d06-41cd-ac21-6a4e7137ed44 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:22.072524 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6f2f9320-0d06-41cd-ac21-6a4e7137ed44 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 35862 microversion: 2.1 time: 0.148930 May 25 15:47:22.073449 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 474/960] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:21 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 35862 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:47:22.150558 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-87d97001-6779-47c0-b28f-9f141e6cb683 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:22.151546 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-87d97001-6779-47c0-b28f-9f141e6cb683 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:22.160864 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87d97001-6779-47c0-b28f-9f141e6cb683 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:22.161587 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87d97001-6779-47c0-b28f-9f141e6cb683 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:22.162373 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87d97001-6779-47c0-b28f-9f141e6cb683 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:22.162985 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87d97001-6779-47c0-b28f-9f141e6cb683 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:22.233022 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87d97001-6779-47c0-b28f-9f141e6cb683 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:22.233785 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-87d97001-6779-47c0-b28f-9f141e6cb683 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:22.234404 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-87d97001-6779-47c0-b28f-9f141e6cb683 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lazy-loading 'fault' on Instance uuid 7712bac3-f186-45b0-bf23-cd5e6c4b4664 {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:47:22.296361 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-87d97001-6779-47c0-b28f-9f141e6cb683 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:22.305789 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-87d97001-6779-47c0-b28f-9f141e6cb683 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 200 len: 1309 microversion: 2.1 time: 0.159462 May 25 15:47:22.306585 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 487/961] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:22 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 1309 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:22.333076 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5c387e98-1a47-45dc-b15f-d3fe1252fd86 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:22.334458 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5c387e98-1a47-45dc-b15f-d3fe1252fd86 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:22.342640 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5c387e98-1a47-45dc-b15f-d3fe1252fd86 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:22.343229 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5c387e98-1a47-45dc-b15f-d3fe1252fd86 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:22.344137 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5c387e98-1a47-45dc-b15f-d3fe1252fd86 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:22.344665 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5c387e98-1a47-45dc-b15f-d3fe1252fd86 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:22.591541 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5c387e98-1a47-45dc-b15f-d3fe1252fd86 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:22.611239 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5c387e98-1a47-45dc-b15f-d3fe1252fd86 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.282095 May 25 15:47:22.612721 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 475/962] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:22 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:22.717051 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:22.717781 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:22.730584 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:22.731168 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:22.732265 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:22.732823 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:22.982548 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:22.991936 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:22.993430 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:22.995118 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1739 microversion: 2.20 time: 0.283549 May 25 15:47:22.995651 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 488/963] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:22 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:23.087707 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4768632b-63c0-4a53-9563-a6300fda4b13 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:23.088976 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4768632b-63c0-4a53-9563-a6300fda4b13 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:23.097032 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4768632b-63c0-4a53-9563-a6300fda4b13 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:23.097706 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4768632b-63c0-4a53-9563-a6300fda4b13 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:23.098658 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4768632b-63c0-4a53-9563-a6300fda4b13 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:23.099098 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4768632b-63c0-4a53-9563-a6300fda4b13 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:23.226141 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4768632b-63c0-4a53-9563-a6300fda4b13 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 37019 microversion: 2.1 time: 0.143947 May 25 15:47:23.227015 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 476/964] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:23 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 37019 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:47:23.324792 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e30d9e0e-eb9f-440a-91ca-cca053cd9bd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:23.325630 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e30d9e0e-eb9f-440a-91ca-cca053cd9bd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: 7712bac3-f186-45b0-bf23-cd5e6c4b4664] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:23.333202 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e30d9e0e-eb9f-440a-91ca-cca053cd9bd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:23.333814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e30d9e0e-eb9f-440a-91ca-cca053cd9bd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:23.334716 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e30d9e0e-eb9f-440a-91ca-cca053cd9bd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:23.335241 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e30d9e0e-eb9f-440a-91ca-cca053cd9bd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:23.390773 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-e30d9e0e-eb9f-440a-91ca-cca053cd9bd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] HTTP exception thrown: Instance 7712bac3-f186-45b0-bf23-cd5e6c4b4664 could not be found. May 25 15:47:23.391391 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e30d9e0e-eb9f-440a-91ca-cca053cd9bd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Returning 404 to user: Instance 7712bac3-f186-45b0-bf23-cd5e6c4b4664 could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:47:23.397016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e30d9e0e-eb9f-440a-91ca-cca053cd9bd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664" status: 404 len: 111 microversion: 2.1 time: 0.071453 May 25 15:47:23.397016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 489/965] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:23 2021] GET /compute/v2.1/servers/7712bac3-f186-45b0-bf23-cd5e6c4b4664 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:47:23.630520 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a5978205-da2d-46ca-ab72-184a8eacc018 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:23.631141 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a5978205-da2d-46ca-ab72-184a8eacc018 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:23.640876 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a5978205-da2d-46ca-ab72-184a8eacc018 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:23.641333 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a5978205-da2d-46ca-ab72-184a8eacc018 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:23.642757 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a5978205-da2d-46ca-ab72-184a8eacc018 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:23.643201 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a5978205-da2d-46ca-ab72-184a8eacc018 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:23.943139 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a5978205-da2d-46ca-ab72-184a8eacc018 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:23.954787 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a5978205-da2d-46ca-ab72-184a8eacc018 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.328727 May 25 15:47:23.955898 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 477/966] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:23 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:24.013382 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-687f0870-e6dd-4e25-bfd3-273919479b8f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:24.014983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-687f0870-e6dd-4e25-bfd3-273919479b8f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:24.023307 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-687f0870-e6dd-4e25-bfd3-273919479b8f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:24.024061 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-687f0870-e6dd-4e25-bfd3-273919479b8f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:24.025309 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-687f0870-e6dd-4e25-bfd3-273919479b8f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:24.025909 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-687f0870-e6dd-4e25-bfd3-273919479b8f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:24.140053 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-6c4d7275-9bfc-422f-ab5a-09d80bc2e8d2 req-72f82e9b-2a5f-498e-ad88-85acffebd061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872c3577-4aec-4d1b-bcba-583bdbea50cb", "name": "network-vif-plugged", "status": "completed", "tag": "241b07d8-fed4-43ac-a7e1-530b98daf731"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:24.144834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:47:24.144834 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:47:24.162670 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-6c4d7275-9bfc-422f-ab5a-09d80bc2e8d2 req-72f82e9b-2a5f-498e-ad88-85acffebd061 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:24.165527 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-6c4d7275-9bfc-422f-ab5a-09d80bc2e8d2 req-72f82e9b-2a5f-498e-ad88-85acffebd061 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:24.195921 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-6c4d7275-9bfc-422f-ab5a-09d80bc2e8d2 req-72f82e9b-2a5f-498e-ad88-85acffebd061 service nova] Creating event network-vif-plugged:241b07d8-fed4-43ac-a7e1-530b98daf731 for instance 872c3577-4aec-4d1b-bcba-583bdbea50cb on hv-cinder-79123 May 25 15:47:24.203700 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-6c4d7275-9bfc-422f-ab5a-09d80bc2e8d2 req-72f82e9b-2a5f-498e-ad88-85acffebd061 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084511 May 25 15:47:24.204864 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 478/967] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:47:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:24.239708 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9a1a0219-0f92-4eec-b715-632c547b4514 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:24.240947 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9a1a0219-0f92-4eec-b715-632c547b4514 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:24.251959 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-687f0870-e6dd-4e25-bfd3-273919479b8f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:24.253026 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9a1a0219-0f92-4eec-b715-632c547b4514 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:24.253763 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9a1a0219-0f92-4eec-b715-632c547b4514 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:24.254735 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9a1a0219-0f92-4eec-b715-632c547b4514 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:24.255445 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9a1a0219-0f92-4eec-b715-632c547b4514 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:24.264878 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-687f0870-e6dd-4e25-bfd3-273919479b8f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:24.266781 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-687f0870-e6dd-4e25-bfd3-273919479b8f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:24.268179 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-687f0870-e6dd-4e25-bfd3-273919479b8f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1739 microversion: 2.20 time: 0.259222 May 25 15:47:24.279014 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 490/968] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:24 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:24.974101 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6f4243e4-d456-4fc8-b845-8e2646f80c46 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:24.974101 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6f4243e4-d456-4fc8-b845-8e2646f80c46 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:24.981807 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6f4243e4-d456-4fc8-b845-8e2646f80c46 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:24.982270 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6f4243e4-d456-4fc8-b845-8e2646f80c46 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:24.983058 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6f4243e4-d456-4fc8-b845-8e2646f80c46 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:24.983493 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6f4243e4-d456-4fc8-b845-8e2646f80c46 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:25.201407 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6f4243e4-d456-4fc8-b845-8e2646f80c46 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:25.210540 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6f4243e4-d456-4fc8-b845-8e2646f80c46 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.241916 May 25 15:47:25.211429 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 491/969] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:24 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:25.286479 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:25.287605 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:25.296074 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:25.296765 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:25.297582 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:25.298018 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:25.510588 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:25.520500 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:25.522280 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:25.523618 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1739 microversion: 2.20 time: 0.241322 May 25 15:47:25.524667 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 492/970] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:25 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:26.227148 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-df62b1c1-5451-4f7d-8ca0-f01f6ae2378d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:26.227793 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-df62b1c1-5451-4f7d-8ca0-f01f6ae2378d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:26.235832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-df62b1c1-5451-4f7d-8ca0-f01f6ae2378d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:26.236563 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-df62b1c1-5451-4f7d-8ca0-f01f6ae2378d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:26.237355 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-df62b1c1-5451-4f7d-8ca0-f01f6ae2378d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:26.237959 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-df62b1c1-5451-4f7d-8ca0-f01f6ae2378d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:26.449063 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-df62b1c1-5451-4f7d-8ca0-f01f6ae2378d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:26.459259 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-df62b1c1-5451-4f7d-8ca0-f01f6ae2378d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.235440 May 25 15:47:26.460613 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 493/971] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:26 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:26.541656 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4d15d130-62a0-4673-bc17-986af24f6d4c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:26.542381 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4d15d130-62a0-4673-bc17-986af24f6d4c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:26.552029 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4d15d130-62a0-4673-bc17-986af24f6d4c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:26.552486 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4d15d130-62a0-4673-bc17-986af24f6d4c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:26.553395 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4d15d130-62a0-4673-bc17-986af24f6d4c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:26.553729 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4d15d130-62a0-4673-bc17-986af24f6d4c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:26.771441 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4d15d130-62a0-4673-bc17-986af24f6d4c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:26.781906 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4d15d130-62a0-4673-bc17-986af24f6d4c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:26.783431 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4d15d130-62a0-4673-bc17-986af24f6d4c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:26.784648 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4d15d130-62a0-4673-bc17-986af24f6d4c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1739 microversion: 2.20 time: 0.246922 May 25 15:47:26.785423 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 494/972] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:26 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:27.476648 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-46abca36-84b4-410e-9b7f-c9fcbc5f0fc9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:27.477321 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-46abca36-84b4-410e-9b7f-c9fcbc5f0fc9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:27.485640 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-46abca36-84b4-410e-9b7f-c9fcbc5f0fc9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:27.486097 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-46abca36-84b4-410e-9b7f-c9fcbc5f0fc9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:27.486879 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-46abca36-84b4-410e-9b7f-c9fcbc5f0fc9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:27.487318 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-46abca36-84b4-410e-9b7f-c9fcbc5f0fc9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:27.654766 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9a1a0219-0f92-4eec-b715-632c547b4514 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 38140 microversion: 2.1 time: 3.419169 May 25 15:47:27.657341 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 479/973] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:24 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 38140 bytes in 3423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:47:27.735477 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-46abca36-84b4-410e-9b7f-c9fcbc5f0fc9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:27.744749 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-46abca36-84b4-410e-9b7f-c9fcbc5f0fc9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.271084 May 25 15:47:27.745598 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 495/974] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:27 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:27.804008 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:27.805256 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:27.830568 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:27.831129 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:27.832071 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:27.832592 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:28.163116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:28.173732 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:28.175821 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:28.177022 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1739 microversion: 2.20 time: 0.377494 May 25 15:47:28.177591 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 480/975] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:27 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1739 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:28.669581 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f31714a9-050e-40bd-8207-9223906ae05f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:28.671322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f31714a9-050e-40bd-8207-9223906ae05f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:28.683791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f31714a9-050e-40bd-8207-9223906ae05f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:28.684523 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f31714a9-050e-40bd-8207-9223906ae05f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:28.685551 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f31714a9-050e-40bd-8207-9223906ae05f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:28.685996 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f31714a9-050e-40bd-8207-9223906ae05f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:28.763075 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6dfcda73-c901-43a7-b146-62c9123f5cfe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:28.763689 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6dfcda73-c901-43a7-b146-62c9123f5cfe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:28.771722 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6dfcda73-c901-43a7-b146-62c9123f5cfe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:28.772398 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6dfcda73-c901-43a7-b146-62c9123f5cfe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:28.773180 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6dfcda73-c901-43a7-b146-62c9123f5cfe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:28.775970 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6dfcda73-c901-43a7-b146-62c9123f5cfe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:28.815731 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f31714a9-050e-40bd-8207-9223906ae05f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 38148 microversion: 2.1 time: 0.151269 May 25 15:47:28.820916 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 496/976] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:28 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 38148 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:47:29.163722 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-6dfcda73-c901-43a7-b146-62c9123f5cfe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:29.174023 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6dfcda73-c901-43a7-b146-62c9123f5cfe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1266 microversion: 2.1 time: 0.415469 May 25 15:47:29.174683 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 481/977] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:28 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1266 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:29.195192 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5f43c439-afd5-4622-8695-b453dc696639 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:29.196000 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5f43c439-afd5-4622-8695-b453dc696639 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:29.204622 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5f43c439-afd5-4622-8695-b453dc696639 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:29.205085 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5f43c439-afd5-4622-8695-b453dc696639 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:29.205890 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5f43c439-afd5-4622-8695-b453dc696639 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:29.206416 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5f43c439-afd5-4622-8695-b453dc696639 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:29.412860 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5f43c439-afd5-4622-8695-b453dc696639 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:29.422832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5f43c439-afd5-4622-8695-b453dc696639 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:29.424407 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5f43c439-afd5-4622-8695-b453dc696639 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:29.425661 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5f43c439-afd5-4622-8695-b453dc696639 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1739 microversion: 2.20 time: 0.234885 May 25 15:47:29.426355 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 497/978] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:29 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:29.827675 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-63ca25bd-0bd8-4073-9bee-b79a67a3a726 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:29.828635 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-63ca25bd-0bd8-4073-9bee-b79a67a3a726 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:29.836131 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-63ca25bd-0bd8-4073-9bee-b79a67a3a726 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:29.836598 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-63ca25bd-0bd8-4073-9bee-b79a67a3a726 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:29.837388 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-63ca25bd-0bd8-4073-9bee-b79a67a3a726 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:29.837835 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-63ca25bd-0bd8-4073-9bee-b79a67a3a726 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:29.963419 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-63ca25bd-0bd8-4073-9bee-b79a67a3a726 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action" status: 200 len: 38268 microversion: 2.1 time: 0.139148 May 25 15:47:29.964285 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 482/979] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:29 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/action => generated 38268 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:47:29.973930 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7d778edd-de3f-4d92-bb25-6f9355d79ef4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:29.974431 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7d778edd-de3f-4d92-bb25-6f9355d79ef4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:29.982545 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7d778edd-de3f-4d92-bb25-6f9355d79ef4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:29.983009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7d778edd-de3f-4d92-bb25-6f9355d79ef4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:29.983828 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7d778edd-de3f-4d92-bb25-6f9355d79ef4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:29.984300 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7d778edd-de3f-4d92-bb25-6f9355d79ef4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:30.041203 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7d778edd-de3f-4d92-bb25-6f9355d79ef4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/ips" status: 200 len: 145 microversion: 2.1 time: 0.070922 May 25 15:47:30.041772 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 498/980] 10.222.0.36 () {58 vars in 1248 bytes} [Tue May 25 15:47:29 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/ips => generated 145 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:30.199430 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9c4ee050-b78e-4aba-a957-06910d587a19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:30.202582 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9c4ee050-b78e-4aba-a957-06910d587a19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:30.210866 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9c4ee050-b78e-4aba-a957-06910d587a19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:30.211407 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9c4ee050-b78e-4aba-a957-06910d587a19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:30.212239 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9c4ee050-b78e-4aba-a957-06910d587a19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:30.212672 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9c4ee050-b78e-4aba-a957-06910d587a19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:30.445513 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-03636782-b5f1-4319-a766-a778ca98d235 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:30.446264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-03636782-b5f1-4319-a766-a778ca98d235 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:30.460530 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-03636782-b5f1-4319-a766-a778ca98d235 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:30.461018 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-03636782-b5f1-4319-a766-a778ca98d235 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:30.461906 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-03636782-b5f1-4319-a766-a778ca98d235 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:30.462352 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-03636782-b5f1-4319-a766-a778ca98d235 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:30.684014 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9c4ee050-b78e-4aba-a957-06910d587a19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:30.691398 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-03636782-b5f1-4319-a766-a778ca98d235 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:30.695650 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9c4ee050-b78e-4aba-a957-06910d587a19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1453 microversion: 2.1 time: 0.506045 May 25 15:47:30.696692 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 483/981] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:30 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1453 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:30.701847 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-03636782-b5f1-4319-a766-a778ca98d235 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:30.703467 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-03636782-b5f1-4319-a766-a778ca98d235 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:30.704864 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-03636782-b5f1-4319-a766-a778ca98d235 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1721 microversion: 2.20 time: 0.263973 May 25 15:47:30.705517 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 499/982] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:30 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:30.711508 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0fe9b578-0264-45b5-9de7-c95039d95a9b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:30.712262 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0fe9b578-0264-45b5-9de7-c95039d95a9b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:30.719896 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0fe9b578-0264-45b5-9de7-c95039d95a9b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:30.720362 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0fe9b578-0264-45b5-9de7-c95039d95a9b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:30.721153 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0fe9b578-0264-45b5-9de7-c95039d95a9b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:30.721609 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0fe9b578-0264-45b5-9de7-c95039d95a9b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:31.089230 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0fe9b578-0264-45b5-9de7-c95039d95a9b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:31.097470 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0fe9b578-0264-45b5-9de7-c95039d95a9b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1453 microversion: 2.1 time: 0.389458 May 25 15:47:31.098025 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 484/983] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:30 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1453 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:31.551692 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-97f8f788-2671-4f6d-8dfa-4ea6bb155106 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df262ed2-0470-4ea1-a02b-6b5b246ad4dc"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:31.552866 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-97f8f788-2671-4f6d-8dfa-4ea6bb155106 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:31.561047 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-97f8f788-2671-4f6d-8dfa-4ea6bb155106 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:31.561508 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-97f8f788-2671-4f6d-8dfa-4ea6bb155106 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:31.562289 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-97f8f788-2671-4f6d-8dfa-4ea6bb155106 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:31.562734 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-97f8f788-2671-4f6d-8dfa-4ea6bb155106 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:31.722588 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:31.723474 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:31.732195 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:31.732655 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:31.733677 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:31.734456 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:31.938053 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:31.946762 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:31.948346 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:31.949479 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1721 microversion: 2.20 time: 0.230758 May 25 15:47:31.950034 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 485/984] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:31 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:32.633462 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-af45233d-dafc-4746-aabe-397d35947787 req-0f815d34-4ecb-4d26-b39a-40e87a8334e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c657feea-6b2e-48ce-a311-464e6b956e0e", "name": "network-vif-unplugged", "status": "completed", "tag": "8c3b5d16-b63c-438e-a031-8606d9e7796f"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:32.635838 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:47:32.635838 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:47:32.645841 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-af45233d-dafc-4746-aabe-397d35947787 req-0f815d34-4ecb-4d26-b39a-40e87a8334e3 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:32.646489 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-af45233d-dafc-4746-aabe-397d35947787 req-0f815d34-4ecb-4d26-b39a-40e87a8334e3 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:32.663585 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-af45233d-dafc-4746-aabe-397d35947787 req-0f815d34-4ecb-4d26-b39a-40e87a8334e3 service nova] Creating event network-vif-unplugged:8c3b5d16-b63c-438e-a031-8606d9e7796f for instance c657feea-6b2e-48ce-a311-464e6b956e0e on hv-cinder-79123 May 25 15:47:32.669191 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-af45233d-dafc-4746-aabe-397d35947787 req-0f815d34-4ecb-4d26-b39a-40e87a8334e3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044241 May 25 15:47:32.670292 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 486/985] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:47:32 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:32.967177 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1613ba62-df06-4ae7-a890-fe435d0ffc35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:32.967914 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1613ba62-df06-4ae7-a890-fe435d0ffc35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:32.975343 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1613ba62-df06-4ae7-a890-fe435d0ffc35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:32.975804 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1613ba62-df06-4ae7-a890-fe435d0ffc35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:32.976618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1613ba62-df06-4ae7-a890-fe435d0ffc35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:32.977062 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1613ba62-df06-4ae7-a890-fe435d0ffc35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:33.178255 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1613ba62-df06-4ae7-a890-fe435d0ffc35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:33.187181 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1613ba62-df06-4ae7-a890-fe435d0ffc35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:33.188756 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1613ba62-df06-4ae7-a890-fe435d0ffc35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:33.189915 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1613ba62-df06-4ae7-a890-fe435d0ffc35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1721 microversion: 2.20 time: 0.227135 May 25 15:47:33.190479 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 487/986] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:32 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:33.600692 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-b80bf6c2-c6c6-45ef-8125-0a082a5feac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872c3577-4aec-4d1b-bcba-583bdbea50cb", "tag": "241b07d8-fed4-43ac-a7e1-530b98daf731"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:33.602293 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:47:33.602293 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:47:33.613998 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-b80bf6c2-c6c6-45ef-8125-0a082a5feac0 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:33.616447 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-b80bf6c2-c6c6-45ef-8125-0a082a5feac0 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:33.632724 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-b80bf6c2-c6c6-45ef-8125-0a082a5feac0 service nova] Creating event network-changed:241b07d8-fed4-43ac-a7e1-530b98daf731 for instance 872c3577-4aec-4d1b-bcba-583bdbea50cb on hv-cinder-79123 May 25 15:47:33.638107 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-b80bf6c2-c6c6-45ef-8125-0a082a5feac0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041019 May 25 15:47:33.638989 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 488/987] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:47:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:34.209436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c5bef527-74c0-47eb-bc31-f849a22fef5d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:34.210153 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c5bef527-74c0-47eb-bc31-f849a22fef5d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:34.218118 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c5bef527-74c0-47eb-bc31-f849a22fef5d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:34.218580 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c5bef527-74c0-47eb-bc31-f849a22fef5d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:34.219399 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c5bef527-74c0-47eb-bc31-f849a22fef5d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:34.219843 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c5bef527-74c0-47eb-bc31-f849a22fef5d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:34.414068 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c5bef527-74c0-47eb-bc31-f849a22fef5d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:34.423347 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c5bef527-74c0-47eb-bc31-f849a22fef5d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:34.424897 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c5bef527-74c0-47eb-bc31-f849a22fef5d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:34.426034 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c5bef527-74c0-47eb-bc31-f849a22fef5d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1721 microversion: 2.20 time: 0.221294 May 25 15:47:34.426624 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 489/988] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:34 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:34.882200 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-97f8f788-2671-4f6d-8dfa-4ea6bb155106 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.333423 May 25 15:47:34.887995 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 500/989] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:47:31 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments => generated 194 bytes in 3341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:35.444919 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:35.445503 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:35.453923 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:35.454388 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:35.455186 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:35.455638 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:35.701888 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:35.710510 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:35.712071 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:35.713727 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1721 microversion: 2.20 time: 0.272839 May 25 15:47:35.714282 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 490/990] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:35 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:35.899787 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-934157403", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "networks": [{"uuid": "3c515845-6e63-4d8b-b829-eb7af03f0236"}]}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:35.963605 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.network.neutron [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] validate_networks() for [('3c515845-6e63-4d8b-b829-eb7af03f0236', None, None, None)] {{(pid=112576) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:47:36.484213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Flavor limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:47:36.484660 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Image limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:47:36.485167 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Flavor pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:47:36.485585 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Image pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:47:36.486004 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:47:36.494924 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:36.495376 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:36.496231 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:36.496682 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:36.514525 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Getting quotas for project fd3e84780cc8404caa2bc8b9b90bcfab. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:47:36.518532 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Getting quotas for user a0a698a38cda4aa8827ed3bf664917f6 and project fd3e84780cc8404caa2bc8b9b90bcfab. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:47:36.528949 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Going to run 1 instances... {{(pid=112576) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:47:36.531310 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112576) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:47:36.577976 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682880 May 25 15:47:36.578628 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 501/991] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:47:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 15:47:36.588558 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-db829203-11e2-4eda-94d6-578a6dde56dd tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:36.589187 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-db829203-11e2-4eda-94d6-578a6dde56dd tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:36.679758 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-db829203-11e2-4eda-94d6-578a6dde56dd tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:36.688420 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-db829203-11e2-4eda-94d6-578a6dde56dd tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1218 microversion: 2.1 time: 0.103659 May 25 15:47:36.689172 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 491/992] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:36 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:36.732065 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-41b47292-3611-4472-b515-1c95c046356b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:36.732727 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-41b47292-3611-4472-b515-1c95c046356b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:36.740551 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-41b47292-3611-4472-b515-1c95c046356b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:36.741018 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-41b47292-3611-4472-b515-1c95c046356b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:36.741808 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-41b47292-3611-4472-b515-1c95c046356b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:36.742257 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-41b47292-3611-4472-b515-1c95c046356b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:36.955273 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-41b47292-3611-4472-b515-1c95c046356b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:36.964865 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-41b47292-3611-4472-b515-1c95c046356b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:36.966423 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-41b47292-3611-4472-b515-1c95c046356b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:36.967588 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-41b47292-3611-4472-b515-1c95c046356b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1721 microversion: 2.20 time: 0.240195 May 25 15:47:36.968182 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 502/993] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:36 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:37.705272 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dcbcbb24-4d96-43cf-810b-9e68dfcf848d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:37.705808 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-dcbcbb24-4d96-43cf-810b-9e68dfcf848d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:37.716010 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dcbcbb24-4d96-43cf-810b-9e68dfcf848d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:37.716475 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dcbcbb24-4d96-43cf-810b-9e68dfcf848d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:37.717257 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dcbcbb24-4d96-43cf-810b-9e68dfcf848d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:37.717702 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dcbcbb24-4d96-43cf-810b-9e68dfcf848d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:37.831810 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-dcbcbb24-4d96-43cf-810b-9e68dfcf848d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:37.840034 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dcbcbb24-4d96-43cf-810b-9e68dfcf848d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1270 microversion: 2.1 time: 0.138531 May 25 15:47:37.840606 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 492/994] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:37 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1270 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:37.986614 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0d14e351-44b4-485e-bfe2-936c80379903 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:37.987242 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0d14e351-44b4-485e-bfe2-936c80379903 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:37.995577 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0d14e351-44b4-485e-bfe2-936c80379903 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:37.996054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0d14e351-44b4-485e-bfe2-936c80379903 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:37.996863 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0d14e351-44b4-485e-bfe2-936c80379903 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:37.997293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0d14e351-44b4-485e-bfe2-936c80379903 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:38.203016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-0d14e351-44b4-485e-bfe2-936c80379903 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:38.212876 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-0d14e351-44b4-485e-bfe2-936c80379903 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:38.214778 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-0d14e351-44b4-485e-bfe2-936c80379903 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:38.216485 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0d14e351-44b4-485e-bfe2-936c80379903 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1664 microversion: 2.20 time: 0.233589 May 25 15:47:38.217745 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 503/995] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:37 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1664 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:38.236576 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b150c6b1-25bd-4e14-8b66-1b72b2519c35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93eeacb0-fcc4-4e88-a0ed-6a7679c5a9ab"}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:38.238123 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b150c6b1-25bd-4e14-8b66-1b72b2519c35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:38.248051 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b150c6b1-25bd-4e14-8b66-1b72b2519c35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:38.248526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b150c6b1-25bd-4e14-8b66-1b72b2519c35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:38.249353 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b150c6b1-25bd-4e14-8b66-1b72b2519c35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:38.249801 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b150c6b1-25bd-4e14-8b66-1b72b2519c35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:38.695317 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b150c6b1-25bd-4e14-8b66-1b72b2519c35 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.464596 May 25 15:47:38.696051 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 493/996] 10.222.0.36 () {62 vars in 1364 bytes} [Tue May 25 15:47:38 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/os-volume_attachments => generated 188 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:47:38.799905 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-703bef05-10f7-4c22-972c-94f1cbea63be tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:38.800410 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-703bef05-10f7-4c22-972c-94f1cbea63be tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:38.808571 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-703bef05-10f7-4c22-972c-94f1cbea63be tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:38.809036 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-703bef05-10f7-4c22-972c-94f1cbea63be tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:38.809827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-703bef05-10f7-4c22-972c-94f1cbea63be tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:38.810271 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-703bef05-10f7-4c22-972c-94f1cbea63be tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:38.857757 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:38.858524 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:38.867192 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:38.867732 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:38.868637 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:38.869781 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:39.250654 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-703bef05-10f7-4c22-972c-94f1cbea63be tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/os-volume_attachments/93eeacb0-fcc4-4e88-a0ed-6a7679c5a9ab" status: 202 len: 0 microversion: 2.20 time: 0.454623 May 25 15:47:39.251846 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 504/997] 10.222.0.36 () {60 vars in 1457 bytes} [Tue May 25 15:47:38 2021] DELETE /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/os-volume_attachments/93eeacb0-fcc4-4e88-a0ed-6a7679c5a9ab => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:47:39.278027 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:39.286399 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.433103 May 25 15:47:39.286967 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 494/998] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:38 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:39.355137 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1bc3588e-bca8-4178-8466-be060a8451a9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:39.355721 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1bc3588e-bca8-4178-8466-be060a8451a9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:39.363124 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1bc3588e-bca8-4178-8466-be060a8451a9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:39.363791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1bc3588e-bca8-4178-8466-be060a8451a9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:39.364618 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1bc3588e-bca8-4178-8466-be060a8451a9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:39.365065 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1bc3588e-bca8-4178-8466-be060a8451a9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:39.513376 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1bc3588e-bca8-4178-8466-be060a8451a9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action" status: 202 len: 0 microversion: 2.20 time: 0.162539 May 25 15:47:39.513984 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 505/999] 10.222.0.36 () {62 vars in 1319 bytes} [Tue May 25 15:47:39 2021] POST /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:47:39.522294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:39.522928 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:39.530817 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:39.531292 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:39.532118 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:39.532703 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:40.068196 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:40.080534 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:40.082762 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:40.084301 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1672 microversion: 2.20 time: 0.565583 May 25 15:47:40.085072 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 495/1000] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:39 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1672 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:40.296038 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-e30e7368-54f2-455e-a255-3525e87b441e req-f65fbb14-b3da-4e6d-8a96-bf87a8dd39f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b386291d-3fac-42b5-86f8-f307a4a5dc0f", "tag": "3def0d10-a624-4491-98d7-d5e621924663"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:40.297764 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:47:40.297764 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:47:40.305167 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6284e51e-862a-4420-b3e0-91e0bb72d806 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:40.306712 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-e30e7368-54f2-455e-a255-3525e87b441e req-f65fbb14-b3da-4e6d-8a96-bf87a8dd39f8 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:40.306990 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6284e51e-862a-4420-b3e0-91e0bb72d806 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:40.307112 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-e30e7368-54f2-455e-a255-3525e87b441e req-f65fbb14-b3da-4e6d-8a96-bf87a8dd39f8 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:40.324263 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-e30e7368-54f2-455e-a255-3525e87b441e req-f65fbb14-b3da-4e6d-8a96-bf87a8dd39f8 service nova] Creating event network-changed:3def0d10-a624-4491-98d7-d5e621924663 for instance b386291d-3fac-42b5-86f8-f307a4a5dc0f on hv-cinder-79123 May 25 15:47:40.325993 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6284e51e-862a-4420-b3e0-91e0bb72d806 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:40.326538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6284e51e-862a-4420-b3e0-91e0bb72d806 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:40.327472 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6284e51e-862a-4420-b3e0-91e0bb72d806 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:40.328072 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6284e51e-862a-4420-b3e0-91e0bb72d806 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:40.329054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-e30e7368-54f2-455e-a255-3525e87b441e req-f65fbb14-b3da-4e6d-8a96-bf87a8dd39f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036702 May 25 15:47:40.330240 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 506/1001] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:47:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:40.646496 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-6284e51e-862a-4420-b3e0-91e0bb72d806 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:40.656112 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6284e51e-862a-4420-b3e0-91e0bb72d806 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.355154 May 25 15:47:40.656691 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 496/1002] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:40 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:41.103126 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b6380f23-a3d5-460b-a039-67b7cd285712 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:41.104355 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b6380f23-a3d5-460b-a039-67b7cd285712 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:41.111703 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b6380f23-a3d5-460b-a039-67b7cd285712 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:41.112228 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b6380f23-a3d5-460b-a039-67b7cd285712 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:41.113067 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b6380f23-a3d5-460b-a039-67b7cd285712 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:41.113510 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b6380f23-a3d5-460b-a039-67b7cd285712 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:41.313542 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b6380f23-a3d5-460b-a039-67b7cd285712 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:41.323035 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b6380f23-a3d5-460b-a039-67b7cd285712 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:41.324603 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b6380f23-a3d5-460b-a039-67b7cd285712 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:41.325768 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b6380f23-a3d5-460b-a039-67b7cd285712 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.226947 May 25 15:47:41.326340 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 507/1003] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:41 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:41.672424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0f736cd2-96db-400b-a36f-eeaadecf3e76 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:41.673032 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0f736cd2-96db-400b-a36f-eeaadecf3e76 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:41.680415 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0f736cd2-96db-400b-a36f-eeaadecf3e76 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:41.680878 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0f736cd2-96db-400b-a36f-eeaadecf3e76 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:41.681707 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0f736cd2-96db-400b-a36f-eeaadecf3e76 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:41.682156 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0f736cd2-96db-400b-a36f-eeaadecf3e76 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:42.198633 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0f736cd2-96db-400b-a36f-eeaadecf3e76 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:42.208666 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0f736cd2-96db-400b-a36f-eeaadecf3e76 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.540011 May 25 15:47:42.209436 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 497/1004] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:41 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:42.343376 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c10d82cc-0050-4218-9b5a-a6465c8a93de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:42.344177 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c10d82cc-0050-4218-9b5a-a6465c8a93de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:42.351546 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c10d82cc-0050-4218-9b5a-a6465c8a93de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:42.352026 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c10d82cc-0050-4218-9b5a-a6465c8a93de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:42.352803 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c10d82cc-0050-4218-9b5a-a6465c8a93de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:42.353308 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c10d82cc-0050-4218-9b5a-a6465c8a93de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:42.566318 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c10d82cc-0050-4218-9b5a-a6465c8a93de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:42.575765 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c10d82cc-0050-4218-9b5a-a6465c8a93de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:42.577325 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c10d82cc-0050-4218-9b5a-a6465c8a93de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:42.578482 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c10d82cc-0050-4218-9b5a-a6465c8a93de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.238819 May 25 15:47:42.579039 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 508/1005] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:42 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:42.710802 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8cd38dc4-ec51-4a2f-8867-d73f6cdaa2ca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:42.711791 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8cd38dc4-ec51-4a2f-8867-d73f6cdaa2ca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:42.719880 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8cd38dc4-ec51-4a2f-8867-d73f6cdaa2ca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:42.720559 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8cd38dc4-ec51-4a2f-8867-d73f6cdaa2ca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:42.721516 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8cd38dc4-ec51-4a2f-8867-d73f6cdaa2ca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:42.722259 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8cd38dc4-ec51-4a2f-8867-d73f6cdaa2ca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:42.793335 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8cd38dc4-ec51-4a2f-8867-d73f6cdaa2ca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086315 May 25 15:47:42.793826 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 498/1006] 10.222.0.36 () {58 vars in 1302 bytes} [Tue May 25 15:47:42 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:42.803911 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2c630ec2-9045-4b14-90fd-c548b73cd075 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:42.804419 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2c630ec2-9045-4b14-90fd-c548b73cd075 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:42.811611 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2c630ec2-9045-4b14-90fd-c548b73cd075 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:42.812184 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2c630ec2-9045-4b14-90fd-c548b73cd075 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:42.812967 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2c630ec2-9045-4b14-90fd-c548b73cd075 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:42.813410 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2c630ec2-9045-4b14-90fd-c548b73cd075 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:42.876754 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2c630ec2-9045-4b14-90fd-c548b73cd075 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments/df262ed2-0470-4ea1-a02b-6b5b246ad4dc" status: 200 len: 194 microversion: 2.1 time: 0.076602 May 25 15:47:42.877342 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 509/1007] 10.222.0.36 () {58 vars in 1413 bytes} [Tue May 25 15:47:42 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments/df262ed2-0470-4ea1-a02b-6b5b246ad4dc => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:43.226577 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-10f7d536-6972-4438-aefe-b527d9a8e353 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:43.227364 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-10f7d536-6972-4438-aefe-b527d9a8e353 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:43.237083 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-10f7d536-6972-4438-aefe-b527d9a8e353 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:43.238891 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-10f7d536-6972-4438-aefe-b527d9a8e353 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:43.241654 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-10f7d536-6972-4438-aefe-b527d9a8e353 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:43.242439 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-10f7d536-6972-4438-aefe-b527d9a8e353 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:43.495296 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-10f7d536-6972-4438-aefe-b527d9a8e353 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:43.505414 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-10f7d536-6972-4438-aefe-b527d9a8e353 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.282767 May 25 15:47:43.506422 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 499/1008] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:43 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:43.597288 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:43.597813 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:43.605668 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:43.606161 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:43.606981 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:43.607424 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:43.817132 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:43.827455 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:43.829191 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:43.830393 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.236959 May 25 15:47:43.830956 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 510/1009] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:43 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:44.221482 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-821277ea-91ee-4d51-9456-7567c3b64842 req-701372e8-372c-4cd9-9ccc-0fda42957078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b386291d-3fac-42b5-86f8-f307a4a5dc0f", "name": "network-vif-plugged", "status": "completed", "tag": "3def0d10-a624-4491-98d7-d5e621924663"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:44.223158 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:47:44.223158 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:47:44.232051 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-821277ea-91ee-4d51-9456-7567c3b64842 req-701372e8-372c-4cd9-9ccc-0fda42957078 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:44.232605 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-821277ea-91ee-4d51-9456-7567c3b64842 req-701372e8-372c-4cd9-9ccc-0fda42957078 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:44.248484 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-821277ea-91ee-4d51-9456-7567c3b64842 req-701372e8-372c-4cd9-9ccc-0fda42957078 service nova] Creating event network-vif-plugged:3def0d10-a624-4491-98d7-d5e621924663 for instance b386291d-3fac-42b5-86f8-f307a4a5dc0f on hv-cinder-79123 May 25 15:47:44.253220 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-821277ea-91ee-4d51-9456-7567c3b64842 req-701372e8-372c-4cd9-9ccc-0fda42957078 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035594 May 25 15:47:44.253996 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 500/1010] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:47:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:44.428905 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a3b18a79-ed90-458c-9c95-15fc6d446848 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73ac83d3-c1cc-4f4b-854e-4ce88bf87cd4"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:44.430065 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a3b18a79-ed90-458c-9c95-15fc6d446848 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:44.438525 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a3b18a79-ed90-458c-9c95-15fc6d446848 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:44.439213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a3b18a79-ed90-458c-9c95-15fc6d446848 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:44.440038 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a3b18a79-ed90-458c-9c95-15fc6d446848 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:44.440478 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a3b18a79-ed90-458c-9c95-15fc6d446848 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:44.522464 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-821a7a75-0eb6-4bed-9834-18a9a19c769b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:44.523351 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-821a7a75-0eb6-4bed-9834-18a9a19c769b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:44.532256 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-821a7a75-0eb6-4bed-9834-18a9a19c769b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:44.533080 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-821a7a75-0eb6-4bed-9834-18a9a19c769b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:44.534184 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-821a7a75-0eb6-4bed-9834-18a9a19c769b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:44.534840 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-821a7a75-0eb6-4bed-9834-18a9a19c769b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:44.749895 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-821a7a75-0eb6-4bed-9834-18a9a19c769b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:44.758562 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-821a7a75-0eb6-4bed-9834-18a9a19c769b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.240470 May 25 15:47:44.759076 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 501/1011] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:44 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:44.849515 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-53c3d4e4-5a21-421f-8352-f5538788cc24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:44.850291 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-53c3d4e4-5a21-421f-8352-f5538788cc24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:44.858408 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-53c3d4e4-5a21-421f-8352-f5538788cc24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:44.858875 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-53c3d4e4-5a21-421f-8352-f5538788cc24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:44.859668 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-53c3d4e4-5a21-421f-8352-f5538788cc24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:44.860142 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-53c3d4e4-5a21-421f-8352-f5538788cc24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:45.062408 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-53c3d4e4-5a21-421f-8352-f5538788cc24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:45.072429 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-53c3d4e4-5a21-421f-8352-f5538788cc24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:45.074107 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-53c3d4e4-5a21-421f-8352-f5538788cc24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:45.075267 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-53c3d4e4-5a21-421f-8352-f5538788cc24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.230012 May 25 15:47:45.075991 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 502/1012] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:44 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:45.778254 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7a1fe2db-08d4-4727-93ba-9bee4bbdb64f tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:45.778934 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7a1fe2db-08d4-4727-93ba-9bee4bbdb64f tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:45.786261 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7a1fe2db-08d4-4727-93ba-9bee4bbdb64f tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:45.786717 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7a1fe2db-08d4-4727-93ba-9bee4bbdb64f tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:45.787489 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7a1fe2db-08d4-4727-93ba-9bee4bbdb64f tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:45.787960 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7a1fe2db-08d4-4727-93ba-9bee4bbdb64f tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:45.996143 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7a1fe2db-08d4-4727-93ba-9bee4bbdb64f tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:46.004354 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7a1fe2db-08d4-4727-93ba-9bee4bbdb64f tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.229896 May 25 15:47:46.004931 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 503/1013] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:45 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:46.093904 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-46da6c1f-1f9a-4057-a065-0381ca340ae3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:46.094445 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-46da6c1f-1f9a-4057-a065-0381ca340ae3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:46.102100 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-46da6c1f-1f9a-4057-a065-0381ca340ae3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:46.102558 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-46da6c1f-1f9a-4057-a065-0381ca340ae3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:46.104003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-46da6c1f-1f9a-4057-a065-0381ca340ae3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:46.104452 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-46da6c1f-1f9a-4057-a065-0381ca340ae3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:46.404018 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-46da6c1f-1f9a-4057-a065-0381ca340ae3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:46.412676 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-46da6c1f-1f9a-4057-a065-0381ca340ae3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:46.414212 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-46da6c1f-1f9a-4057-a065-0381ca340ae3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:46.416253 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-46da6c1f-1f9a-4057-a065-0381ca340ae3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.325599 May 25 15:47:46.416825 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 504/1014] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:46 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:47.021715 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-77703f6f-757a-42c5-877d-92b86e7aa4c0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:47.022364 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-77703f6f-757a-42c5-877d-92b86e7aa4c0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:47.030421 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-77703f6f-757a-42c5-877d-92b86e7aa4c0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:47.030917 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-77703f6f-757a-42c5-877d-92b86e7aa4c0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:47.031695 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-77703f6f-757a-42c5-877d-92b86e7aa4c0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:47.032163 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-77703f6f-757a-42c5-877d-92b86e7aa4c0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:47.254281 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-77703f6f-757a-42c5-877d-92b86e7aa4c0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:47.263852 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-77703f6f-757a-42c5-877d-92b86e7aa4c0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.245707 May 25 15:47:47.264754 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 505/1015] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:47 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:47.434996 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:47.435628 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:47.443382 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:47.443774 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:47.444601 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:47.445050 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:47.643523 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:47.652275 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:47.653799 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:47.654931 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.224309 May 25 15:47:47.655483 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 506/1016] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:47 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:48.281352 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0156d1bf-907c-4a21-962c-16879879d9a0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:48.282001 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0156d1bf-907c-4a21-962c-16879879d9a0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:48.289760 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0156d1bf-907c-4a21-962c-16879879d9a0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:48.290310 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0156d1bf-907c-4a21-962c-16879879d9a0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:48.291417 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0156d1bf-907c-4a21-962c-16879879d9a0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:48.292443 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0156d1bf-907c-4a21-962c-16879879d9a0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:48.496158 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0156d1bf-907c-4a21-962c-16879879d9a0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:48.504786 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0156d1bf-907c-4a21-962c-16879879d9a0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.227180 May 25 15:47:48.505400 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 507/1017] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:48 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:48.672340 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:48.672885 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:48.681428 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:48.681891 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:48.682983 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:48.683581 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:48.894190 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:48.903931 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:48.905457 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:48.906765 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.238209 May 25 15:47:48.907351 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 508/1018] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:48 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:49.521727 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b56f6c00-ed32-419e-9376-989e4e2e3cb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:49.522384 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b56f6c00-ed32-419e-9376-989e4e2e3cb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:49.531669 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b56f6c00-ed32-419e-9376-989e4e2e3cb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:49.532322 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b56f6c00-ed32-419e-9376-989e4e2e3cb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:49.533226 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b56f6c00-ed32-419e-9376-989e4e2e3cb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:49.533700 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b56f6c00-ed32-419e-9376-989e4e2e3cb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:49.735765 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b56f6c00-ed32-419e-9376-989e4e2e3cb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:49.749409 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b56f6c00-ed32-419e-9376-989e4e2e3cb3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.231161 May 25 15:47:49.751139 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 509/1019] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:49 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:49.924924 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-623f3aaa-7a15-48cc-ba83-c852eb01e185 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:49.925540 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-623f3aaa-7a15-48cc-ba83-c852eb01e185 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:49.932790 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-623f3aaa-7a15-48cc-ba83-c852eb01e185 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:49.933274 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-623f3aaa-7a15-48cc-ba83-c852eb01e185 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:49.934048 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-623f3aaa-7a15-48cc-ba83-c852eb01e185 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:49.934486 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-623f3aaa-7a15-48cc-ba83-c852eb01e185 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:50.145978 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-623f3aaa-7a15-48cc-ba83-c852eb01e185 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:50.155385 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-623f3aaa-7a15-48cc-ba83-c852eb01e185 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:50.156935 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-623f3aaa-7a15-48cc-ba83-c852eb01e185 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:50.158077 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-623f3aaa-7a15-48cc-ba83-c852eb01e185 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.237007 May 25 15:47:50.158634 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 510/1020] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:49 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:50.768749 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c422da89-7ab3-469a-8ff6-76b9f58dd0dd tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:50.769426 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c422da89-7ab3-469a-8ff6-76b9f58dd0dd tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:50.777644 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c422da89-7ab3-469a-8ff6-76b9f58dd0dd tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:50.778103 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c422da89-7ab3-469a-8ff6-76b9f58dd0dd tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:50.778889 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c422da89-7ab3-469a-8ff6-76b9f58dd0dd tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:50.779335 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c422da89-7ab3-469a-8ff6-76b9f58dd0dd tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:50.985976 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-c422da89-7ab3-469a-8ff6-76b9f58dd0dd tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:50.994491 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c422da89-7ab3-469a-8ff6-76b9f58dd0dd tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.229697 May 25 15:47:50.995065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 511/1021] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:50 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:51.176057 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:51.176620 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:51.185095 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:51.185560 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:51.186334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:51.186777 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:51.394121 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:51.403556 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:51.405122 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:51.406289 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.234106 May 25 15:47:51.407052 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 512/1022] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:51 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:52.010421 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-02faa3ef-0cf1-4452-84b4-f2c4db663206 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:52.011092 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-02faa3ef-0cf1-4452-84b4-f2c4db663206 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:52.019277 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02faa3ef-0cf1-4452-84b4-f2c4db663206 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:52.019746 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02faa3ef-0cf1-4452-84b4-f2c4db663206 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:52.020558 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02faa3ef-0cf1-4452-84b4-f2c4db663206 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:52.021006 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-02faa3ef-0cf1-4452-84b4-f2c4db663206 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:52.224151 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-02faa3ef-0cf1-4452-84b4-f2c4db663206 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:52.233018 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-02faa3ef-0cf1-4452-84b4-f2c4db663206 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.226344 May 25 15:47:52.233593 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 513/1023] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:52 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:52.424647 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-348eb279-1081-4174-9e06-a5b333efc86d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:52.425784 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-348eb279-1081-4174-9e06-a5b333efc86d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:52.433751 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-348eb279-1081-4174-9e06-a5b333efc86d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:52.434567 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-348eb279-1081-4174-9e06-a5b333efc86d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:52.435761 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-348eb279-1081-4174-9e06-a5b333efc86d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:52.436461 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-348eb279-1081-4174-9e06-a5b333efc86d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:52.641280 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-348eb279-1081-4174-9e06-a5b333efc86d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:52.649954 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-348eb279-1081-4174-9e06-a5b333efc86d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:52.651464 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-348eb279-1081-4174-9e06-a5b333efc86d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:52.652656 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-348eb279-1081-4174-9e06-a5b333efc86d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.232342 May 25 15:47:52.653322 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 514/1024] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:52 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:53.250146 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-28f59039-02b4-49a1-95c4-b444bb2cb3b1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:53.250814 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-28f59039-02b4-49a1-95c4-b444bb2cb3b1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:53.258321 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-28f59039-02b4-49a1-95c4-b444bb2cb3b1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:53.258784 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-28f59039-02b4-49a1-95c4-b444bb2cb3b1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:53.259580 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-28f59039-02b4-49a1-95c4-b444bb2cb3b1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:53.260063 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-28f59039-02b4-49a1-95c4-b444bb2cb3b1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:53.511489 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-28f59039-02b4-49a1-95c4-b444bb2cb3b1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:53.520004 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-28f59039-02b4-49a1-95c4-b444bb2cb3b1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.274182 May 25 15:47:53.520571 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 515/1025] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:53 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:53.676782 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e1516cf7-02c5-43bf-b345-b89166971239 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:53.677482 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e1516cf7-02c5-43bf-b345-b89166971239 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:53.684999 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1516cf7-02c5-43bf-b345-b89166971239 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:53.685464 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1516cf7-02c5-43bf-b345-b89166971239 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:53.686300 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1516cf7-02c5-43bf-b345-b89166971239 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:53.686873 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1516cf7-02c5-43bf-b345-b89166971239 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:53.898306 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e1516cf7-02c5-43bf-b345-b89166971239 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:53.908721 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e1516cf7-02c5-43bf-b345-b89166971239 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:53.910361 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e1516cf7-02c5-43bf-b345-b89166971239 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:53.911602 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e1516cf7-02c5-43bf-b345-b89166971239 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.238678 May 25 15:47:53.912536 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 516/1026] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:53 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:54.250721 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:47:54.251632 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:54.259283 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:54.259740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:54.260566 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:54.261011 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:54.319405 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.objects.instance [None req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lazy-loading 'flavor' on Instance uuid a4b8d3b0-aceb-4f56-a13d-7d0696f42901 {{(pid=112577) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:47:54.474588 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "POST /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901/action" status: 202 len: 0 microversion: 2.1 time: 0.227278 May 25 15:47:54.478648 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 517/1027] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:47:54 2021] POST /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:47:54.485486 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dc6bd3a8-b70a-4a2e-9c8a-8422ea4d050a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:54.486302 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-dc6bd3a8-b70a-4a2e-9c8a-8422ea4d050a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:54.494539 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dc6bd3a8-b70a-4a2e-9c8a-8422ea4d050a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:54.495015 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dc6bd3a8-b70a-4a2e-9c8a-8422ea4d050a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:54.496442 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dc6bd3a8-b70a-4a2e-9c8a-8422ea4d050a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:54.496888 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dc6bd3a8-b70a-4a2e-9c8a-8422ea4d050a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:54.716751 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-dc6bd3a8-b70a-4a2e-9c8a-8422ea4d050a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:54.725337 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dc6bd3a8-b70a-4a2e-9c8a-8422ea4d050a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.245028 May 25 15:47:54.725914 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 518/1028] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:54 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:54.730779 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-38d0e36e-4fa1-44e3-889e-f23abaea7a28 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:54.731426 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-38d0e36e-4fa1-44e3-889e-f23abaea7a28 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:54.738492 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-38d0e36e-4fa1-44e3-889e-f23abaea7a28 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:54.738949 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-38d0e36e-4fa1-44e3-889e-f23abaea7a28 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:54.739745 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-38d0e36e-4fa1-44e3-889e-f23abaea7a28 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:54.740215 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-38d0e36e-4fa1-44e3-889e-f23abaea7a28 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:54.949185 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-38d0e36e-4fa1-44e3-889e-f23abaea7a28 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:54.958058 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-38d0e36e-4fa1-44e3-889e-f23abaea7a28 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.231128 May 25 15:47:54.958888 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 519/1029] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:54 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:54.963039 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:54.963658 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:54.972752 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:54.973205 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:54.974021 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:54.974462 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:55.181724 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:55.190326 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:55.191833 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:55.192995 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.233376 May 25 15:47:55.193745 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 520/1030] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:54 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:55.744766 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d3d1819b-4328-4707-b6f7-93f0338b58d7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:55.745970 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d3d1819b-4328-4707-b6f7-93f0338b58d7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:55.754140 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d3d1819b-4328-4707-b6f7-93f0338b58d7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:55.754593 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d3d1819b-4328-4707-b6f7-93f0338b58d7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:55.755380 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d3d1819b-4328-4707-b6f7-93f0338b58d7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:55.755849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d3d1819b-4328-4707-b6f7-93f0338b58d7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:55.959193 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d3d1819b-4328-4707-b6f7-93f0338b58d7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:55.968036 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d3d1819b-4328-4707-b6f7-93f0338b58d7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.226973 May 25 15:47:55.968605 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 521/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:55 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:55.973707 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e1ab881c-7484-4d94-9438-9c5ae5ef4a88 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:55.974429 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e1ab881c-7484-4d94-9438-9c5ae5ef4a88 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:55.982322 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1ab881c-7484-4d94-9438-9c5ae5ef4a88 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:55.982812 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1ab881c-7484-4d94-9438-9c5ae5ef4a88 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:55.983720 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1ab881c-7484-4d94-9438-9c5ae5ef4a88 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:55.984232 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e1ab881c-7484-4d94-9438-9c5ae5ef4a88 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:56.185152 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e1ab881c-7484-4d94-9438-9c5ae5ef4a88 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:56.193615 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e1ab881c-7484-4d94-9438-9c5ae5ef4a88 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.223084 May 25 15:47:56.194195 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 522/1032] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:55 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:56.210515 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-eb929601-da91-418b-9725-c97d642ac60f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:56.211136 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-eb929601-da91-418b-9725-c97d642ac60f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:56.219342 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-eb929601-da91-418b-9725-c97d642ac60f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:56.219798 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-eb929601-da91-418b-9725-c97d642ac60f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:56.220735 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-eb929601-da91-418b-9725-c97d642ac60f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:56.221181 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-eb929601-da91-418b-9725-c97d642ac60f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:56.494922 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-eb929601-da91-418b-9725-c97d642ac60f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:56.504649 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-eb929601-da91-418b-9725-c97d642ac60f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:56.506201 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-eb929601-da91-418b-9725-c97d642ac60f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:56.507355 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-eb929601-da91-418b-9725-c97d642ac60f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.300570 May 25 15:47:56.508011 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 523/1033] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:56 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:56.986058 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e4feaeff-9e2c-4f06-a3cc-2b950e223b83 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:56.986725 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e4feaeff-9e2c-4f06-a3cc-2b950e223b83 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:56.994185 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e4feaeff-9e2c-4f06-a3cc-2b950e223b83 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:56.994646 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e4feaeff-9e2c-4f06-a3cc-2b950e223b83 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:56.995424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e4feaeff-9e2c-4f06-a3cc-2b950e223b83 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:56.995889 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e4feaeff-9e2c-4f06-a3cc-2b950e223b83 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:57.204593 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e4feaeff-9e2c-4f06-a3cc-2b950e223b83 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:57.213985 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e4feaeff-9e2c-4f06-a3cc-2b950e223b83 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.231657 May 25 15:47:57.215416 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 524/1034] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:56 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:47:57.220377 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-598dfc56-70fd-43d0-bb27-74944c672400 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:57.221025 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-598dfc56-70fd-43d0-bb27-74944c672400 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:57.228690 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-598dfc56-70fd-43d0-bb27-74944c672400 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:57.229135 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-598dfc56-70fd-43d0-bb27-74944c672400 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:57.229910 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-598dfc56-70fd-43d0-bb27-74944c672400 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:57.231111 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-598dfc56-70fd-43d0-bb27-74944c672400 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:57.346339 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a3b18a79-ed90-458c-9c95-15fc6d446848 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.921061 May 25 15:47:57.347384 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 511/1035] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:47:44 2021] POST /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments => generated 194 bytes in 12923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:47:57.514312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-598dfc56-70fd-43d0-bb27-74944c672400 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:57.522984 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-598dfc56-70fd-43d0-bb27-74944c672400 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.306375 May 25 15:47:57.523556 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 525/1036] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:57 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:57.528010 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ef112669-395e-4c38-abfa-ac4894c3f693 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:57.528951 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ef112669-395e-4c38-abfa-ac4894c3f693 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:57.537182 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef112669-395e-4c38-abfa-ac4894c3f693 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:57.537645 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef112669-395e-4c38-abfa-ac4894c3f693 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:57.538427 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef112669-395e-4c38-abfa-ac4894c3f693 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:57.538877 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef112669-395e-4c38-abfa-ac4894c3f693 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:57.738726 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ef112669-395e-4c38-abfa-ac4894c3f693 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:57.747501 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ef112669-395e-4c38-abfa-ac4894c3f693 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:57.749072 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ef112669-395e-4c38-abfa-ac4894c3f693 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:57.750227 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ef112669-395e-4c38-abfa-ac4894c3f693 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.227265 May 25 15:47:57.750789 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 512/1037] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:57 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:47:58.231534 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dceca677-cfb9-400f-b3d5-fc4456410c7b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:58.232199 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-dceca677-cfb9-400f-b3d5-fc4456410c7b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:58.239573 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dceca677-cfb9-400f-b3d5-fc4456410c7b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:58.240073 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dceca677-cfb9-400f-b3d5-fc4456410c7b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:58.240855 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dceca677-cfb9-400f-b3d5-fc4456410c7b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:58.241305 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dceca677-cfb9-400f-b3d5-fc4456410c7b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:58.439678 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-dceca677-cfb9-400f-b3d5-fc4456410c7b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:58.447972 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dceca677-cfb9-400f-b3d5-fc4456410c7b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.220780 May 25 15:47:58.448555 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 526/1038] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:58 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:58.539989 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-957c5653-43f6-4deb-ad9b-d70902aa5d05 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:58.540617 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-957c5653-43f6-4deb-ad9b-d70902aa5d05 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:58.548351 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-957c5653-43f6-4deb-ad9b-d70902aa5d05 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:58.548808 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-957c5653-43f6-4deb-ad9b-d70902aa5d05 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:58.549593 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-957c5653-43f6-4deb-ad9b-d70902aa5d05 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:58.550075 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-957c5653-43f6-4deb-ad9b-d70902aa5d05 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:58.741602 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-957c5653-43f6-4deb-ad9b-d70902aa5d05 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:58.750418 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-957c5653-43f6-4deb-ad9b-d70902aa5d05 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1318 microversion: 2.1 time: 0.214132 May 25 15:47:58.751017 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 513/1039] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:58 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:58.768559 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2ae66942-044c-4943-8ba4-82f803ec078b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:58.769125 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2ae66942-044c-4943-8ba4-82f803ec078b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:58.776333 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2ae66942-044c-4943-8ba4-82f803ec078b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:58.776796 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2ae66942-044c-4943-8ba4-82f803ec078b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:58.777580 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2ae66942-044c-4943-8ba4-82f803ec078b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:58.778028 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2ae66942-044c-4943-8ba4-82f803ec078b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:58.987628 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2ae66942-044c-4943-8ba4-82f803ec078b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:58.996915 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2ae66942-044c-4943-8ba4-82f803ec078b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:58.998419 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2ae66942-044c-4943-8ba4-82f803ec078b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:58.999602 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2ae66942-044c-4943-8ba4-82f803ec078b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.235074 May 25 15:47:59.000202 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 527/1040] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:47:58 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:47:59.466254 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-75385e81-0685-45c2-8028-a0b5fcb9a2c0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:59.466892 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-75385e81-0685-45c2-8028-a0b5fcb9a2c0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:59.474264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-75385e81-0685-45c2-8028-a0b5fcb9a2c0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:59.474733 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-75385e81-0685-45c2-8028-a0b5fcb9a2c0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:59.475510 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-75385e81-0685-45c2-8028-a0b5fcb9a2c0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:59.476011 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-75385e81-0685-45c2-8028-a0b5fcb9a2c0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:59.675834 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-75385e81-0685-45c2-8028-a0b5fcb9a2c0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:59.684886 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-75385e81-0685-45c2-8028-a0b5fcb9a2c0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.222963 May 25 15:47:59.685456 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 514/1041] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:59 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:47:59.767087 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-70b98c18-9fab-4d66-bd0d-76634da2b323 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:47:59.767706 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-70b98c18-9fab-4d66-bd0d-76634da2b323 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:47:59.774927 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-70b98c18-9fab-4d66-bd0d-76634da2b323 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:59.775380 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-70b98c18-9fab-4d66-bd0d-76634da2b323 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:59.776186 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-70b98c18-9fab-4d66-bd0d-76634da2b323 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:59.776623 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-70b98c18-9fab-4d66-bd0d-76634da2b323 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:59.975991 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-70b98c18-9fab-4d66-bd0d-76634da2b323 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:47:59.984800 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-70b98c18-9fab-4d66-bd0d-76634da2b323 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1507 microversion: 2.1 time: 0.221680 May 25 15:47:59.985367 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 528/1042] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:47:59 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:00.001336 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f36b8c6a-599b-4ca3-aba3-3dfee5ddc02e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8e2a2bb-fc14-4aae-a6e2-d42cd67e67e8", "device": "/dev/sdb"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:48:00.002505 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f36b8c6a-599b-4ca3-aba3-3dfee5ddc02e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:00.009733 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f36b8c6a-599b-4ca3-aba3-3dfee5ddc02e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:00.010194 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f36b8c6a-599b-4ca3-aba3-3dfee5ddc02e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:00.010976 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f36b8c6a-599b-4ca3-aba3-3dfee5ddc02e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:00.011419 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f36b8c6a-599b-4ca3-aba3-3dfee5ddc02e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:00.017002 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:00.017623 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:00.024805 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:00.025285 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:00.026053 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:00.026499 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:00.234644 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:00.244528 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:00.246038 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:00.247706 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.234121 May 25 15:48:00.251069 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 529/1043] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:48:00 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:48:00.410038 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f36b8c6a-599b-4ca3-aba3-3dfee5ddc02e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "POST /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412236 May 25 15:48:00.410758 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 515/1044] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:47:59 2021] POST /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:48:00.702099 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5a8f51fe-9c1c-4cc1-ab88-91a784da5363 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:00.702761 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5a8f51fe-9c1c-4cc1-ab88-91a784da5363 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:00.710092 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a8f51fe-9c1c-4cc1-ab88-91a784da5363 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:00.710561 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a8f51fe-9c1c-4cc1-ab88-91a784da5363 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:00.711579 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a8f51fe-9c1c-4cc1-ab88-91a784da5363 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:00.712170 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5a8f51fe-9c1c-4cc1-ab88-91a784da5363 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:00.913575 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5a8f51fe-9c1c-4cc1-ab88-91a784da5363 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:00.922609 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5a8f51fe-9c1c-4cc1-ab88-91a784da5363 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.224571 May 25 15:48:00.923545 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 530/1045] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:00 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:01.268340 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c45de4c5-0a4f-4f9b-8305-750f063ff75e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:01.269053 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c45de4c5-0a4f-4f9b-8305-750f063ff75e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:01.277130 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c45de4c5-0a4f-4f9b-8305-750f063ff75e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:01.278289 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c45de4c5-0a4f-4f9b-8305-750f063ff75e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:01.279070 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c45de4c5-0a4f-4f9b-8305-750f063ff75e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:01.279514 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c45de4c5-0a4f-4f9b-8305-750f063ff75e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:01.476193 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c45de4c5-0a4f-4f9b-8305-750f063ff75e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:01.484899 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c45de4c5-0a4f-4f9b-8305-750f063ff75e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:01.486422 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c45de4c5-0a4f-4f9b-8305-750f063ff75e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:01.487574 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c45de4c5-0a4f-4f9b-8305-750f063ff75e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.224234 May 25 15:48:01.488244 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 516/1046] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:48:01 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:48:01.939846 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e7691acf-a773-4744-a97e-52bd50c2d535 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:01.940483 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e7691acf-a773-4744-a97e-52bd50c2d535 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:01.947746 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e7691acf-a773-4744-a97e-52bd50c2d535 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:01.948227 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e7691acf-a773-4744-a97e-52bd50c2d535 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:01.948993 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e7691acf-a773-4744-a97e-52bd50c2d535 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:01.949434 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e7691acf-a773-4744-a97e-52bd50c2d535 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:02.142849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e7691acf-a773-4744-a97e-52bd50c2d535 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:02.151168 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e7691acf-a773-4744-a97e-52bd50c2d535 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.215031 May 25 15:48:02.151744 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 531/1047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:01 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:02.346798 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-7bf685f7-4cd8-4039-801e-ae0a2dbb13a9 req-0b6e5ad3-e63f-454b-be05-2687e100e260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c657feea-6b2e-48ce-a311-464e6b956e0e", "name": "network-vif-plugged", "status": "completed", "tag": "8c3b5d16-b63c-438e-a031-8606d9e7796f"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:48:02.348443 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:48:02.348443 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:48:02.356923 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-7bf685f7-4cd8-4039-801e-ae0a2dbb13a9 req-0b6e5ad3-e63f-454b-be05-2687e100e260 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:02.357433 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-7bf685f7-4cd8-4039-801e-ae0a2dbb13a9 req-0b6e5ad3-e63f-454b-be05-2687e100e260 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:02.374282 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-7bf685f7-4cd8-4039-801e-ae0a2dbb13a9 req-0b6e5ad3-e63f-454b-be05-2687e100e260 service nova] Creating event network-vif-plugged:8c3b5d16-b63c-438e-a031-8606d9e7796f for instance c657feea-6b2e-48ce-a311-464e6b956e0e on hv-cinder-79123 May 25 15:48:02.378906 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-7bf685f7-4cd8-4039-801e-ae0a2dbb13a9 req-0b6e5ad3-e63f-454b-be05-2687e100e260 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035974 May 25 15:48:02.379497 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 517/1048] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:48:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:48:02.505370 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-950f3c08-f85b-4530-8dd2-e9765fcc5721 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:02.506106 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-950f3c08-f85b-4530-8dd2-e9765fcc5721 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:02.515303 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-950f3c08-f85b-4530-8dd2-e9765fcc5721 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:02.515884 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-950f3c08-f85b-4530-8dd2-e9765fcc5721 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:02.516771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-950f3c08-f85b-4530-8dd2-e9765fcc5721 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:02.517314 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-950f3c08-f85b-4530-8dd2-e9765fcc5721 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:02.820897 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-950f3c08-f85b-4530-8dd2-e9765fcc5721 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:02.829777 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-950f3c08-f85b-4530-8dd2-e9765fcc5721 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:02.831293 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-950f3c08-f85b-4530-8dd2-e9765fcc5721 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:02.832465 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-950f3c08-f85b-4530-8dd2-e9765fcc5721 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.330932 May 25 15:48:02.833029 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 532/1049] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:48:02 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:48:03.169100 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-cfa2963e-de17-4e2b-ba7d-f15590e20ef3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:03.169737 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-cfa2963e-de17-4e2b-ba7d-f15590e20ef3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:03.177322 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cfa2963e-de17-4e2b-ba7d-f15590e20ef3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:03.177789 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cfa2963e-de17-4e2b-ba7d-f15590e20ef3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:03.178573 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cfa2963e-de17-4e2b-ba7d-f15590e20ef3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:03.179021 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-cfa2963e-de17-4e2b-ba7d-f15590e20ef3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:03.465386 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-cfa2963e-de17-4e2b-ba7d-f15590e20ef3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:03.473661 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-cfa2963e-de17-4e2b-ba7d-f15590e20ef3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.309444 May 25 15:48:03.474237 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 518/1050] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:03 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:03.850240 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4a440896-d6f2-4ac1-9284-ffc2afd37107 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:03.850853 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4a440896-d6f2-4ac1-9284-ffc2afd37107 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:03.858948 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4a440896-d6f2-4ac1-9284-ffc2afd37107 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:03.859414 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4a440896-d6f2-4ac1-9284-ffc2afd37107 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:03.860224 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4a440896-d6f2-4ac1-9284-ffc2afd37107 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:03.860675 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4a440896-d6f2-4ac1-9284-ffc2afd37107 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:04.055883 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4a440896-d6f2-4ac1-9284-ffc2afd37107 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:04.064629 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4a440896-d6f2-4ac1-9284-ffc2afd37107 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:04.066180 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4a440896-d6f2-4ac1-9284-ffc2afd37107 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:04.067328 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4a440896-d6f2-4ac1-9284-ffc2afd37107 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1730 microversion: 2.20 time: 0.220875 May 25 15:48:04.067907 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 533/1051] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:48:03 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:48:04.490893 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4a5b7d97-1565-4682-a071-5d0555ecb262 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:04.491431 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4a5b7d97-1565-4682-a071-5d0555ecb262 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:04.499683 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4a5b7d97-1565-4682-a071-5d0555ecb262 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:04.500280 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4a5b7d97-1565-4682-a071-5d0555ecb262 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:04.500950 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4a5b7d97-1565-4682-a071-5d0555ecb262 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:04.501384 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4a5b7d97-1565-4682-a071-5d0555ecb262 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:04.703986 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4a5b7d97-1565-4682-a071-5d0555ecb262 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:04.712217 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4a5b7d97-1565-4682-a071-5d0555ecb262 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.225513 May 25 15:48:04.712785 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 519/1052] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:04 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:05.085540 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3b17df0d-4fd6-490e-9048-af2fda307a24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:05.086398 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3b17df0d-4fd6-490e-9048-af2fda307a24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:05.094522 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b17df0d-4fd6-490e-9048-af2fda307a24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:05.095066 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b17df0d-4fd6-490e-9048-af2fda307a24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:05.096066 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b17df0d-4fd6-490e-9048-af2fda307a24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:05.096507 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3b17df0d-4fd6-490e-9048-af2fda307a24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:05.303757 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3b17df0d-4fd6-490e-9048-af2fda307a24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:05.313487 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3b17df0d-4fd6-490e-9048-af2fda307a24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:05.315014 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3b17df0d-4fd6-490e-9048-af2fda307a24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:05.316200 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3b17df0d-4fd6-490e-9048-af2fda307a24 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1717 microversion: 2.20 time: 0.234721 May 25 15:48:05.316762 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 534/1053] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:48:05 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1717 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:48:05.729769 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-dfafe1d2-0317-4eef-b529-da0f40a8189b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:05.730906 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-dfafe1d2-0317-4eef-b529-da0f40a8189b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:05.738042 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dfafe1d2-0317-4eef-b529-da0f40a8189b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:05.738496 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dfafe1d2-0317-4eef-b529-da0f40a8189b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:05.739263 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dfafe1d2-0317-4eef-b529-da0f40a8189b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:05.739700 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dfafe1d2-0317-4eef-b529-da0f40a8189b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:05.935890 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-dfafe1d2-0317-4eef-b529-da0f40a8189b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:05.946408 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-dfafe1d2-0317-4eef-b529-da0f40a8189b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.218809 May 25 15:48:05.946408 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 520/1054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:05 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:06.223532 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-6aa76bea-f52c-41d0-936f-015bd28bad09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:06.224564 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-6aa76bea-f52c-41d0-936f-015bd28bad09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:06.231854 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6aa76bea-f52c-41d0-936f-015bd28bad09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:06.232361 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6aa76bea-f52c-41d0-936f-015bd28bad09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:06.233147 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6aa76bea-f52c-41d0-936f-015bd28bad09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:06.233596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-6aa76bea-f52c-41d0-936f-015bd28bad09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:06.298561 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-6aa76bea-f52c-41d0-936f-015bd28bad09 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.078652 May 25 15:48:06.299064 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 535/1055] 10.222.0.36 () {58 vars in 1302 bytes} [Tue May 25 15:48:06 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:48:06.594202 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4c2dd7fb-5460-438a-9bcf-a7dca1d76ac7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:06.594633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4c2dd7fb-5460-438a-9bcf-a7dca1d76ac7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:06.601983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4c2dd7fb-5460-438a-9bcf-a7dca1d76ac7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:06.602422 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4c2dd7fb-5460-438a-9bcf-a7dca1d76ac7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:06.603199 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4c2dd7fb-5460-438a-9bcf-a7dca1d76ac7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:06.603643 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4c2dd7fb-5460-438a-9bcf-a7dca1d76ac7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:06.668195 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4c2dd7fb-5460-438a-9bcf-a7dca1d76ac7 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments/df262ed2-0470-4ea1-a02b-6b5b246ad4dc" status: 200 len: 194 microversion: 2.1 time: 0.077229 May 25 15:48:06.668887 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 521/1056] 10.222.0.36 () {58 vars in 1413 bytes} [Tue May 25 15:48:06 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments/df262ed2-0470-4ea1-a02b-6b5b246ad4dc => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:48:06.678618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f682bea4-ea29-4fd0-836f-681de05f867b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:06.679127 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f682bea4-ea29-4fd0-836f-681de05f867b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:06.686896 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f682bea4-ea29-4fd0-836f-681de05f867b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:06.687356 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f682bea4-ea29-4fd0-836f-681de05f867b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:06.688180 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f682bea4-ea29-4fd0-836f-681de05f867b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:06.688625 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f682bea4-ea29-4fd0-836f-681de05f867b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:06.846100 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.objects.instance [None req-f682bea4-ea29-4fd0-836f-681de05f867b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lazy-loading 'services' on Instance uuid 4b093877-20ab-4678-8d94-a89983bda325 {{(pid=112577) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:48:06.962256 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-73e837db-02c3-4c56-b482-3d6629d25085 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:06.962928 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-73e837db-02c3-4c56-b482-3d6629d25085 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:06.971207 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-73e837db-02c3-4c56-b482-3d6629d25085 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:06.971772 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-73e837db-02c3-4c56-b482-3d6629d25085 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:06.972700 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-73e837db-02c3-4c56-b482-3d6629d25085 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:06.973347 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-73e837db-02c3-4c56-b482-3d6629d25085 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:06.985110 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f682bea4-ea29-4fd0-836f-681de05f867b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments/df262ed2-0470-4ea1-a02b-6b5b246ad4dc" status: 202 len: 0 microversion: 2.1 time: 0.310065 May 25 15:48:06.985905 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 536/1057] 10.222.0.36 () {58 vars in 1416 bytes} [Tue May 25 15:48:06 2021] DELETE /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments/df262ed2-0470-4ea1-a02b-6b5b246ad4dc => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:48:07.202324 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-73e837db-02c3-4c56-b482-3d6629d25085 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:07.210681 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-73e837db-02c3-4c56-b482-3d6629d25085 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.252111 May 25 15:48:07.211246 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 522/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:06 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:48:08.228352 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a6140481-6961-4dc7-bfcc-ace8a6766dcb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:08.229071 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a6140481-6961-4dc7-bfcc-ace8a6766dcb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:08.237272 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a6140481-6961-4dc7-bfcc-ace8a6766dcb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:08.237736 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a6140481-6961-4dc7-bfcc-ace8a6766dcb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:08.238552 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a6140481-6961-4dc7-bfcc-ace8a6766dcb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:08.238997 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a6140481-6961-4dc7-bfcc-ace8a6766dcb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:08.434240 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a6140481-6961-4dc7-bfcc-ace8a6766dcb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:08.442398 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a6140481-6961-4dc7-bfcc-ace8a6766dcb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.218313 May 25 15:48:08.442960 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 537/1059] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:08 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:09.459280 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0e7511ab-b9ce-4c25-89b0-9b520ca23eea tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:09.459976 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0e7511ab-b9ce-4c25-89b0-9b520ca23eea tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:09.467655 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0e7511ab-b9ce-4c25-89b0-9b520ca23eea tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:09.468157 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0e7511ab-b9ce-4c25-89b0-9b520ca23eea tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:09.468939 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0e7511ab-b9ce-4c25-89b0-9b520ca23eea tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:09.469387 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0e7511ab-b9ce-4c25-89b0-9b520ca23eea tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:09.664382 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-0e7511ab-b9ce-4c25-89b0-9b520ca23eea tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:09.673298 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0e7511ab-b9ce-4c25-89b0-9b520ca23eea tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.217705 May 25 15:48:09.673881 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 523/1060] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:09 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:10.690327 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0e344032-04e2-42e6-a975-59af1fd8b7b8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:10.690955 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0e344032-04e2-42e6-a975-59af1fd8b7b8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:10.698266 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0e344032-04e2-42e6-a975-59af1fd8b7b8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:10.698727 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0e344032-04e2-42e6-a975-59af1fd8b7b8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:10.700217 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0e344032-04e2-42e6-a975-59af1fd8b7b8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:10.700734 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0e344032-04e2-42e6-a975-59af1fd8b7b8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:10.895522 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-0e344032-04e2-42e6-a975-59af1fd8b7b8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:10.903830 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0e344032-04e2-42e6-a975-59af1fd8b7b8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.217359 May 25 15:48:10.904427 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 538/1061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:10 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:11.921327 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4522b276-558d-47ec-8bdd-3e9b3a5607b9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:11.921967 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4522b276-558d-47ec-8bdd-3e9b3a5607b9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:11.929305 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4522b276-558d-47ec-8bdd-3e9b3a5607b9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:11.929759 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4522b276-558d-47ec-8bdd-3e9b3a5607b9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:11.930532 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4522b276-558d-47ec-8bdd-3e9b3a5607b9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:11.930976 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4522b276-558d-47ec-8bdd-3e9b3a5607b9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:12.120466 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4522b276-558d-47ec-8bdd-3e9b3a5607b9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:12.129542 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4522b276-558d-47ec-8bdd-3e9b3a5607b9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.212473 May 25 15:48:12.130339 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 524/1062] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:11 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:13.146516 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-661aeda3-b1ad-4bd7-9c2d-a8ad4f09ed63 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:13.147138 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-661aeda3-b1ad-4bd7-9c2d-a8ad4f09ed63 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:13.155097 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-661aeda3-b1ad-4bd7-9c2d-a8ad4f09ed63 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:13.155554 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-661aeda3-b1ad-4bd7-9c2d-a8ad4f09ed63 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:13.156363 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-661aeda3-b1ad-4bd7-9c2d-a8ad4f09ed63 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:13.156804 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-661aeda3-b1ad-4bd7-9c2d-a8ad4f09ed63 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:13.526371 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-661aeda3-b1ad-4bd7-9c2d-a8ad4f09ed63 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:13.536437 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-661aeda3-b1ad-4bd7-9c2d-a8ad4f09ed63 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.393603 May 25 15:48:13.537008 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 539/1063] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:13 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:14.553183 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-727faaa6-578f-45b5-b8fd-46cac22c3713 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:14.553845 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-727faaa6-578f-45b5-b8fd-46cac22c3713 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:14.561588 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-727faaa6-578f-45b5-b8fd-46cac22c3713 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:14.562053 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-727faaa6-578f-45b5-b8fd-46cac22c3713 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:14.562841 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-727faaa6-578f-45b5-b8fd-46cac22c3713 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:14.563315 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-727faaa6-578f-45b5-b8fd-46cac22c3713 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:14.766221 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-727faaa6-578f-45b5-b8fd-46cac22c3713 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:14.774748 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-727faaa6-578f-45b5-b8fd-46cac22c3713 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.225339 May 25 15:48:14.775315 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 525/1064] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:14 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:14.780206 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5db75410-cec9-4c9b-8332-1925546cb866 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:14.780713 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5db75410-cec9-4c9b-8332-1925546cb866 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:14.787901 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5db75410-cec9-4c9b-8332-1925546cb866 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:14.788359 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5db75410-cec9-4c9b-8332-1925546cb866 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:14.789137 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5db75410-cec9-4c9b-8332-1925546cb866 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:14.789578 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5db75410-cec9-4c9b-8332-1925546cb866 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:14.853195 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5db75410-cec9-4c9b-8332-1925546cb866 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments/73ac83d3-c1cc-4f4b-854e-4ce88bf87cd4" status: 200 len: 194 microversion: 2.1 time: 0.077434 May 25 15:48:14.853702 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 540/1065] 10.222.0.36 () {58 vars in 1413 bytes} [Tue May 25 15:48:14 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments/73ac83d3-c1cc-4f4b-854e-4ce88bf87cd4 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:48:14.863568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-526400ef-5234-4f79-a086-b15f14b26c3a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:14.864104 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-526400ef-5234-4f79-a086-b15f14b26c3a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:14.872157 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-526400ef-5234-4f79-a086-b15f14b26c3a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:14.872609 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-526400ef-5234-4f79-a086-b15f14b26c3a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:14.873575 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-526400ef-5234-4f79-a086-b15f14b26c3a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:14.874012 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-526400ef-5234-4f79-a086-b15f14b26c3a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:15.036488 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-526400ef-5234-4f79-a086-b15f14b26c3a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lazy-loading 'services' on Instance uuid 4b093877-20ab-4678-8d94-a89983bda325 {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:48:15.175299 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-526400ef-5234-4f79-a086-b15f14b26c3a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments/73ac83d3-c1cc-4f4b-854e-4ce88bf87cd4" status: 202 len: 0 microversion: 2.1 time: 0.315521 May 25 15:48:15.175980 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 526/1066] 10.222.0.36 () {58 vars in 1416 bytes} [Tue May 25 15:48:14 2021] DELETE /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325/os-volume_attachments/73ac83d3-c1cc-4f4b-854e-4ce88bf87cd4 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:48:15.795200 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-171079d1-479f-448d-a3aa-2617d0a8108b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:15.796553 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-171079d1-479f-448d-a3aa-2617d0a8108b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:15.807078 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-171079d1-479f-448d-a3aa-2617d0a8108b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:15.807826 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-171079d1-479f-448d-a3aa-2617d0a8108b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:15.808904 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-171079d1-479f-448d-a3aa-2617d0a8108b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:15.809502 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-171079d1-479f-448d-a3aa-2617d0a8108b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:16.021677 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-171079d1-479f-448d-a3aa-2617d0a8108b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:16.030091 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-171079d1-479f-448d-a3aa-2617d0a8108b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.239870 May 25 15:48:16.030649 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 541/1067] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:15 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:48:17.047048 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1cb6d683-3f06-4608-9d37-526bd38c7519 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:17.047767 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1cb6d683-3f06-4608-9d37-526bd38c7519 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:17.055512 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1cb6d683-3f06-4608-9d37-526bd38c7519 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:17.056012 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1cb6d683-3f06-4608-9d37-526bd38c7519 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:17.056801 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1cb6d683-3f06-4608-9d37-526bd38c7519 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:17.057252 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1cb6d683-3f06-4608-9d37-526bd38c7519 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:17.254606 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1cb6d683-3f06-4608-9d37-526bd38c7519 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:17.265080 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1cb6d683-3f06-4608-9d37-526bd38c7519 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.221933 May 25 15:48:17.265659 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 527/1068] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:17 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:18.281855 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d2ab68d4-213d-4472-ba19-9846de6c3f11 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:18.282484 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d2ab68d4-213d-4472-ba19-9846de6c3f11 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:18.289783 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d2ab68d4-213d-4472-ba19-9846de6c3f11 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:18.290245 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d2ab68d4-213d-4472-ba19-9846de6c3f11 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:18.291027 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d2ab68d4-213d-4472-ba19-9846de6c3f11 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:18.291477 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d2ab68d4-213d-4472-ba19-9846de6c3f11 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:18.558093 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d2ab68d4-213d-4472-ba19-9846de6c3f11 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:18.567790 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d2ab68d4-213d-4472-ba19-9846de6c3f11 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.289460 May 25 15:48:18.568468 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 542/1069] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:18 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:19.586385 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-30d40cda-9ab9-48f5-8677-6291cac4676d tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:19.587052 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-30d40cda-9ab9-48f5-8677-6291cac4676d tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:19.595969 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-30d40cda-9ab9-48f5-8677-6291cac4676d tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:19.596434 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-30d40cda-9ab9-48f5-8677-6291cac4676d tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:19.597224 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-30d40cda-9ab9-48f5-8677-6291cac4676d tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:19.597856 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-30d40cda-9ab9-48f5-8677-6291cac4676d tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:19.804741 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-30d40cda-9ab9-48f5-8677-6291cac4676d tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:19.814788 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-30d40cda-9ab9-48f5-8677-6291cac4676d tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.231481 May 25 15:48:19.815271 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 528/1070] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:19 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:20.023357 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:20.023886 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:20.032190 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:20.032655 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:20.033438 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:20.033882 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:20.093867 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Going to try to terminate instance {{(pid=112577) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:48:20.202031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 204 len: 0 microversion: 2.1 time: 0.181964 May 25 15:48:20.202542 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 543/1071] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:48:20 2021] DELETE /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:48:20.210469 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9be0c76e-b6c9-4890-9c0f-fffb6dcba062 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:20.211164 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9be0c76e-b6c9-4890-9c0f-fffb6dcba062 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:20.219280 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9be0c76e-b6c9-4890-9c0f-fffb6dcba062 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:20.219736 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9be0c76e-b6c9-4890-9c0f-fffb6dcba062 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:20.220549 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9be0c76e-b6c9-4890-9c0f-fffb6dcba062 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:20.220989 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9be0c76e-b6c9-4890-9c0f-fffb6dcba062 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:20.417854 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9be0c76e-b6c9-4890-9c0f-fffb6dcba062 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:20.426473 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9be0c76e-b6c9-4890-9c0f-fffb6dcba062 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1673 microversion: 2.1 time: 0.219714 May 25 15:48:20.427039 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 529/1072] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:20 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1673 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:20.831635 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9bb6b55a-5722-45e1-9ec9-1dd5eb2832d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:20.832379 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9bb6b55a-5722-45e1-9ec9-1dd5eb2832d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:20.839670 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9bb6b55a-5722-45e1-9ec9-1dd5eb2832d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:20.840162 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9bb6b55a-5722-45e1-9ec9-1dd5eb2832d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:20.840939 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9bb6b55a-5722-45e1-9ec9-1dd5eb2832d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:20.841380 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9bb6b55a-5722-45e1-9ec9-1dd5eb2832d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:21.113632 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9bb6b55a-5722-45e1-9ec9-1dd5eb2832d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:21.121989 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9bb6b55a-5722-45e1-9ec9-1dd5eb2832d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.294550 May 25 15:48:21.122555 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 544/1073] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:20 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:48:21.444054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ec0881c5-fc1f-4658-bf68-982ae657a1b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:21.444681 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ec0881c5-fc1f-4658-bf68-982ae657a1b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:21.452107 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ec0881c5-fc1f-4658-bf68-982ae657a1b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:21.452565 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ec0881c5-fc1f-4658-bf68-982ae657a1b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:21.453341 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ec0881c5-fc1f-4658-bf68-982ae657a1b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:21.453781 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ec0881c5-fc1f-4658-bf68-982ae657a1b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:21.644450 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ec0881c5-fc1f-4658-bf68-982ae657a1b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:21.652618 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ec0881c5-fc1f-4658-bf68-982ae657a1b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1673 microversion: 2.1 time: 0.212346 May 25 15:48:21.653198 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 530/1074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:21 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1673 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:22.140424 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-401d2b71-396a-47d1-8bc2-dff46775dca5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:22.141057 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-401d2b71-396a-47d1-8bc2-dff46775dca5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:22.148353 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-401d2b71-396a-47d1-8bc2-dff46775dca5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:22.148808 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-401d2b71-396a-47d1-8bc2-dff46775dca5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:22.149587 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-401d2b71-396a-47d1-8bc2-dff46775dca5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:22.150028 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-401d2b71-396a-47d1-8bc2-dff46775dca5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:22.345884 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-401d2b71-396a-47d1-8bc2-dff46775dca5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:22.354067 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-401d2b71-396a-47d1-8bc2-dff46775dca5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.218110 May 25 15:48:22.354629 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 545/1075] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:22 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:22.669891 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ff6278d4-7301-4436-a8da-11f0ab9e1c4e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:22.670522 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ff6278d4-7301-4436-a8da-11f0ab9e1c4e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:22.678048 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ff6278d4-7301-4436-a8da-11f0ab9e1c4e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:22.678514 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ff6278d4-7301-4436-a8da-11f0ab9e1c4e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:22.679303 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ff6278d4-7301-4436-a8da-11f0ab9e1c4e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:22.679777 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ff6278d4-7301-4436-a8da-11f0ab9e1c4e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:22.878895 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ff6278d4-7301-4436-a8da-11f0ab9e1c4e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:22.887230 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ff6278d4-7301-4436-a8da-11f0ab9e1c4e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1673 microversion: 2.1 time: 0.221030 May 25 15:48:22.887813 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 531/1076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:22 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1673 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:23.370992 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-96cdff6a-e1b2-407b-830c-3cd6396ae25b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:23.371623 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-96cdff6a-e1b2-407b-830c-3cd6396ae25b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:23.379541 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-96cdff6a-e1b2-407b-830c-3cd6396ae25b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:23.380037 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-96cdff6a-e1b2-407b-830c-3cd6396ae25b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:23.380821 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-96cdff6a-e1b2-407b-830c-3cd6396ae25b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:23.381270 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-96cdff6a-e1b2-407b-830c-3cd6396ae25b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:23.577908 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-96cdff6a-e1b2-407b-830c-3cd6396ae25b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:23.586149 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-96cdff6a-e1b2-407b-830c-3cd6396ae25b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.218957 May 25 15:48:23.586712 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 546/1077] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:23 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:23.904810 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b50f1500-975c-4803-8567-128ab9293d42 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:23.905377 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b50f1500-975c-4803-8567-128ab9293d42 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:23.912829 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b50f1500-975c-4803-8567-128ab9293d42 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:23.913282 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b50f1500-975c-4803-8567-128ab9293d42 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:23.914057 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b50f1500-975c-4803-8567-128ab9293d42 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:23.914502 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b50f1500-975c-4803-8567-128ab9293d42 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:24.106403 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b50f1500-975c-4803-8567-128ab9293d42 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:24.115152 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b50f1500-975c-4803-8567-128ab9293d42 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1673 microversion: 2.1 time: 0.214132 May 25 15:48:24.115727 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 532/1078] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:23 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1673 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:24.355072 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-17a91897-9e6d-4152-845e-b69cad7569c9 req-5161e36c-3ee2-4683-a273-21b3d874982c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b8d3b0-aceb-4f56-a13d-7d0696f42901", "name": "network-vif-unplugged", "status": "completed", "tag": "7ae06ec7-6469-494a-b223-ce3de0a0e2da"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:48:24.356984 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:48:24.356984 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:48:24.365787 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-17a91897-9e6d-4152-845e-b69cad7569c9 req-5161e36c-3ee2-4683-a273-21b3d874982c service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:24.366334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-17a91897-9e6d-4152-845e-b69cad7569c9 req-5161e36c-3ee2-4683-a273-21b3d874982c service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:24.383291 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-17a91897-9e6d-4152-845e-b69cad7569c9 req-5161e36c-3ee2-4683-a273-21b3d874982c service nova] Creating event network-vif-unplugged:7ae06ec7-6469-494a-b223-ce3de0a0e2da for instance a4b8d3b0-aceb-4f56-a13d-7d0696f42901 on hv-cinder-79123 May 25 15:48:24.388534 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-17a91897-9e6d-4152-845e-b69cad7569c9 req-5161e36c-3ee2-4683-a273-21b3d874982c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038252 May 25 15:48:24.389803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 547/1079] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:48:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:48:24.602444 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-24e63944-e2e9-4be3-8c4c-fcdc7d287d9f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:24.603069 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-24e63944-e2e9-4be3-8c4c-fcdc7d287d9f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:24.610511 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-24e63944-e2e9-4be3-8c4c-fcdc7d287d9f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:24.611025 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-24e63944-e2e9-4be3-8c4c-fcdc7d287d9f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:24.611807 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-24e63944-e2e9-4be3-8c4c-fcdc7d287d9f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:24.612286 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-24e63944-e2e9-4be3-8c4c-fcdc7d287d9f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:24.813211 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-24e63944-e2e9-4be3-8c4c-fcdc7d287d9f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:24.822209 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-24e63944-e2e9-4be3-8c4c-fcdc7d287d9f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1570 microversion: 2.1 time: 0.223463 May 25 15:48:24.822875 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 533/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:24 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1570 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:24.839433 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:48:24.840161 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:24.847652 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:24.848148 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:24.848927 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:24.849376 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:24.994259 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "POST /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901/action" status: 202 len: 0 microversion: 2.1 time: 0.158766 May 25 15:48:24.995192 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 548/1081] 10.222.0.36 () {60 vars in 1278 bytes} [Tue May 25 15:48:24 2021] POST /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:48:25.003685 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bc1c7d47-f367-41c9-91a0-4cf28360a88f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:25.004499 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bc1c7d47-f367-41c9-91a0-4cf28360a88f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:25.012412 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bc1c7d47-f367-41c9-91a0-4cf28360a88f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:25.013001 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bc1c7d47-f367-41c9-91a0-4cf28360a88f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:25.014266 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bc1c7d47-f367-41c9-91a0-4cf28360a88f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:25.015195 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bc1c7d47-f367-41c9-91a0-4cf28360a88f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:25.133479 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-bf186d16-565c-4aa2-bd41-636a1660a52c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:25.134199 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-bf186d16-565c-4aa2-bd41-636a1660a52c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:25.142180 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bf186d16-565c-4aa2-bd41-636a1660a52c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:25.142651 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bf186d16-565c-4aa2-bd41-636a1660a52c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:25.143481 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bf186d16-565c-4aa2-bd41-636a1660a52c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:25.143948 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bf186d16-565c-4aa2-bd41-636a1660a52c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:25.255435 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-bc1c7d47-f367-41c9-91a0-4cf28360a88f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:25.268684 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bc1c7d47-f367-41c9-91a0-4cf28360a88f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1518 microversion: 2.1 time: 0.268826 May 25 15:48:25.269268 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 534/1082] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:24 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1518 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:25.370206 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-bf186d16-565c-4aa2-bd41-636a1660a52c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:25.378820 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-bf186d16-565c-4aa2-bd41-636a1660a52c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1673 microversion: 2.1 time: 0.249576 May 25 15:48:25.379398 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 549/1083] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:25 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1673 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:26.285937 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b075f9e2-e077-496c-b080-358364e5c361 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:26.286567 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b075f9e2-e077-496c-b080-358364e5c361 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:26.293858 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b075f9e2-e077-496c-b080-358364e5c361 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:26.294323 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b075f9e2-e077-496c-b080-358364e5c361 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:26.295614 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b075f9e2-e077-496c-b080-358364e5c361 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:26.296110 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b075f9e2-e077-496c-b080-358364e5c361 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:26.396769 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d1413cb2-ad83-4b7f-beb7-742ce7134cf3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:26.397419 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d1413cb2-ad83-4b7f-beb7-742ce7134cf3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:26.404673 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1413cb2-ad83-4b7f-beb7-742ce7134cf3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:26.405135 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1413cb2-ad83-4b7f-beb7-742ce7134cf3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:26.405920 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1413cb2-ad83-4b7f-beb7-742ce7134cf3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:26.406367 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1413cb2-ad83-4b7f-beb7-742ce7134cf3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:26.503192 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b075f9e2-e077-496c-b080-358364e5c361 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:26.511843 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b075f9e2-e077-496c-b080-358364e5c361 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1520 microversion: 2.1 time: 0.229494 May 25 15:48:26.512435 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 535/1084] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:26 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:26.611686 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d1413cb2-ad83-4b7f-beb7-742ce7134cf3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:26.620081 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d1413cb2-ad83-4b7f-beb7-742ce7134cf3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1673 microversion: 2.1 time: 0.227172 May 25 15:48:26.620661 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 550/1085] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:26 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:48:27.533116 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f9106d4a-170f-4216-be33-75247be1a0c2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:27.533745 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f9106d4a-170f-4216-be33-75247be1a0c2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:27.541071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f9106d4a-170f-4216-be33-75247be1a0c2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:27.541531 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f9106d4a-170f-4216-be33-75247be1a0c2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:27.542314 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f9106d4a-170f-4216-be33-75247be1a0c2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:27.542786 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f9106d4a-170f-4216-be33-75247be1a0c2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:27.638283 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-823a8a52-9294-41bb-adb6-0949f5fb0d68 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:27.639155 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-823a8a52-9294-41bb-adb6-0949f5fb0d68 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:27.648945 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-823a8a52-9294-41bb-adb6-0949f5fb0d68 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:27.649685 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-823a8a52-9294-41bb-adb6-0949f5fb0d68 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:27.650554 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-823a8a52-9294-41bb-adb6-0949f5fb0d68 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:27.651202 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-823a8a52-9294-41bb-adb6-0949f5fb0d68 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:27.754143 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f9106d4a-170f-4216-be33-75247be1a0c2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:27.762332 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f9106d4a-170f-4216-be33-75247be1a0c2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.233525 May 25 15:48:27.762908 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 536/1086] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:27 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:28.195423 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-fb3e44d6-d223-44c9-a0e3-25edd4a94dd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:28.195975 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-fb3e44d6-d223-44c9-a0e3-25edd4a94dd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:28.204003 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fb3e44d6-d223-44c9-a0e3-25edd4a94dd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:28.204465 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fb3e44d6-d223-44c9-a0e3-25edd4a94dd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:28.205241 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fb3e44d6-d223-44c9-a0e3-25edd4a94dd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:28.205684 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fb3e44d6-d223-44c9-a0e3-25edd4a94dd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:28.281627 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-823a8a52-9294-41bb-adb6-0949f5fb0d68 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:28.290074 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-823a8a52-9294-41bb-adb6-0949f5fb0d68 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1673 microversion: 2.1 time: 0.655806 May 25 15:48:28.290832 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 551/1087] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:27 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1673 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:48:28.398893 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-fb3e44d6-d223-44c9-a0e3-25edd4a94dd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lazy-loading 'services' on Instance uuid b386291d-3fac-42b5-86f8-f307a4a5dc0f {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:48:28.550296 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-fb3e44d6-d223-44c9-a0e3-25edd4a94dd3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f/os-volume_attachments/c8e2a2bb-fc14-4aae-a6e2-d42cd67e67e8" status: 202 len: 0 microversion: 2.1 time: 0.358444 May 25 15:48:28.554248 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 537/1088] 10.222.0.36 () {58 vars in 1416 bytes} [Tue May 25 15:48:28 2021] DELETE /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f/os-volume_attachments/c8e2a2bb-fc14-4aae-a6e2-d42cd67e67e8 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:48:28.779906 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-88777d2e-a0dd-42b2-b6ef-4a8df3ce8b2a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:28.780537 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-88777d2e-a0dd-42b2-b6ef-4a8df3ce8b2a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:28.788429 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-88777d2e-a0dd-42b2-b6ef-4a8df3ce8b2a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:28.788921 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-88777d2e-a0dd-42b2-b6ef-4a8df3ce8b2a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:28.789718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-88777d2e-a0dd-42b2-b6ef-4a8df3ce8b2a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:28.790266 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-88777d2e-a0dd-42b2-b6ef-4a8df3ce8b2a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:28.932264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-1481dc28-442a-4404-baa0-d9f59043d597 req-2302404d-09b6-4179-b14c-79119aa276b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b093877-20ab-4678-8d94-a89983bda325", "name": "network-vif-deleted", "tag": "a7d32eab-b1e5-4dcd-bb06-5f06e6841586"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:48:28.933956 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:48:28.933956 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:48:28.944586 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-1481dc28-442a-4404-baa0-d9f59043d597 req-2302404d-09b6-4179-b14c-79119aa276b8 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:28.945274 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-1481dc28-442a-4404-baa0-d9f59043d597 req-2302404d-09b6-4179-b14c-79119aa276b8 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:28.963831 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-1481dc28-442a-4404-baa0-d9f59043d597 req-2302404d-09b6-4179-b14c-79119aa276b8 service nova] Creating event network-vif-deleted:a7d32eab-b1e5-4dcd-bb06-5f06e6841586 for instance 4b093877-20ab-4678-8d94-a89983bda325 on hv-cinder-79123 May 25 15:48:28.970060 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-1481dc28-442a-4404-baa0-d9f59043d597 req-2302404d-09b6-4179-b14c-79119aa276b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042107 May 25 15:48:28.971353 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 538/1089] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:48:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:48:29.133596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-88777d2e-a0dd-42b2-b6ef-4a8df3ce8b2a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:29.145407 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-88777d2e-a0dd-42b2-b6ef-4a8df3ce8b2a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.369054 May 25 15:48:29.146590 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 552/1090] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:28 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:29.307666 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b43cac90-72c8-46eb-b504-c3b15aa2d368 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:29.308421 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b43cac90-72c8-46eb-b504-c3b15aa2d368 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:29.315996 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b43cac90-72c8-46eb-b504-c3b15aa2d368 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:29.316466 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b43cac90-72c8-46eb-b504-c3b15aa2d368 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:29.317264 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b43cac90-72c8-46eb-b504-c3b15aa2d368 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:29.317713 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b43cac90-72c8-46eb-b504-c3b15aa2d368 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:29.388439 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b43cac90-72c8-46eb-b504-c3b15aa2d368 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:29.389426 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b43cac90-72c8-46eb-b504-c3b15aa2d368 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:29.390439 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-b43cac90-72c8-46eb-b504-c3b15aa2d368 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lazy-loading 'fault' on Instance uuid 4b093877-20ab-4678-8d94-a89983bda325 {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:48:29.447889 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b43cac90-72c8-46eb-b504-c3b15aa2d368 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff91a3b3f9f64b2f8ed2cc67943c1d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:29.456827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b43cac90-72c8-46eb-b504-c3b15aa2d368 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 200 len: 1327 microversion: 2.1 time: 0.153293 May 25 15:48:29.457457 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 539/1091] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:29 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 1327 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:29.751366 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f375e648-49e0-40e0-b2e7-a086a08e9462 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:29.751901 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f375e648-49e0-40e0-b2e7-a086a08e9462 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:29.760440 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f375e648-49e0-40e0-b2e7-a086a08e9462 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:29.760934 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f375e648-49e0-40e0-b2e7-a086a08e9462 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:29.761709 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f375e648-49e0-40e0-b2e7-a086a08e9462 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:29.762148 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f375e648-49e0-40e0-b2e7-a086a08e9462 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:29.827977 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f375e648-49e0-40e0-b2e7-a086a08e9462 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Going to try to terminate instance {{(pid=112577) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:48:29.954538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f375e648-49e0-40e0-b2e7-a086a08e9462 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 204 len: 0 microversion: 2.1 time: 0.207754 May 25 15:48:29.955578 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 553/1092] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:48:29 2021] DELETE /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:48:29.964504 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a2338e8c-16c3-47b6-bf31-fcbfbfcba766 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:29.965186 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a2338e8c-16c3-47b6-bf31-fcbfbfcba766 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:29.972951 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a2338e8c-16c3-47b6-bf31-fcbfbfcba766 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:29.973466 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a2338e8c-16c3-47b6-bf31-fcbfbfcba766 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:29.974194 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a2338e8c-16c3-47b6-bf31-fcbfbfcba766 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:29.974641 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a2338e8c-16c3-47b6-bf31-fcbfbfcba766 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:30.163573 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e09a7e6f-427b-4b1c-9b4e-2f6a1d0b3014 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:30.164216 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e09a7e6f-427b-4b1c-9b4e-2f6a1d0b3014 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:30.172429 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e09a7e6f-427b-4b1c-9b4e-2f6a1d0b3014 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:30.172887 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e09a7e6f-427b-4b1c-9b4e-2f6a1d0b3014 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:30.173668 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e09a7e6f-427b-4b1c-9b4e-2f6a1d0b3014 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:30.174106 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e09a7e6f-427b-4b1c-9b4e-2f6a1d0b3014 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:30.285247 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a2338e8c-16c3-47b6-bf31-fcbfbfcba766 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:30.293778 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a2338e8c-16c3-47b6-bf31-fcbfbfcba766 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1513 microversion: 2.1 time: 0.333765 May 25 15:48:30.294495 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 540/1093] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:29 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1513 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:30.398824 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e09a7e6f-427b-4b1c-9b4e-2f6a1d0b3014 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:30.409262 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e09a7e6f-427b-4b1c-9b4e-2f6a1d0b3014 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.250328 May 25 15:48:30.409883 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 554/1094] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:30 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:48:30.474025 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c8cf4e87-5077-4bf2-b26b-fa327a5e3b60 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:30.474588 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c8cf4e87-5077-4bf2-b26b-fa327a5e3b60 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:30.481913 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c8cf4e87-5077-4bf2-b26b-fa327a5e3b60 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:30.483022 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c8cf4e87-5077-4bf2-b26b-fa327a5e3b60 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:30.483835 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c8cf4e87-5077-4bf2-b26b-fa327a5e3b60 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:30.484305 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c8cf4e87-5077-4bf2-b26b-fa327a5e3b60 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:30.532795 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-c8cf4e87-5077-4bf2-b26b-fa327a5e3b60 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] HTTP exception thrown: Instance 4b093877-20ab-4678-8d94-a89983bda325 could not be found. May 25 15:48:30.533401 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c8cf4e87-5077-4bf2-b26b-fa327a5e3b60 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Returning 404 to user: Instance 4b093877-20ab-4678-8d94-a89983bda325 could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:48:30.534229 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c8cf4e87-5077-4bf2-b26b-fa327a5e3b60 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 404 len: 111 microversion: 2.1 time: 0.063983 May 25 15:48:30.534761 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 541/1095] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:30 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:48:30.542924 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f0963fa2-e622-42b0-ad50-20a85f9cb85a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '.version_select at 0x7f088519b5e0>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:30.563680 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f0963fa2-e622-42b0-ad50-20a85f9cb85a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517409382" status: 202 len: 0 microversion: 2.1 time: 0.024372 May 25 15:48:30.564282 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 555/1096] 10.222.0.36 () {58 vars in 1221 bytes} [Tue May 25 15:48:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517409382 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:48:31.311045 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-eb08ac7c-a311-4e0e-b97e-93bc68fd9695 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:31.311664 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-eb08ac7c-a311-4e0e-b97e-93bc68fd9695 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:31.321429 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb08ac7c-a311-4e0e-b97e-93bc68fd9695 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:31.321956 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb08ac7c-a311-4e0e-b97e-93bc68fd9695 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:31.322825 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb08ac7c-a311-4e0e-b97e-93bc68fd9695 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:31.323348 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-eb08ac7c-a311-4e0e-b97e-93bc68fd9695 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:31.426932 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b62b3a9d-9cc5-4b8e-98ac-5804c828e4e7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:31.427565 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b62b3a9d-9cc5-4b8e-98ac-5804c828e4e7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:31.434865 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b62b3a9d-9cc5-4b8e-98ac-5804c828e4e7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:31.435333 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b62b3a9d-9cc5-4b8e-98ac-5804c828e4e7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:31.436157 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b62b3a9d-9cc5-4b8e-98ac-5804c828e4e7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:31.436622 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b62b3a9d-9cc5-4b8e-98ac-5804c828e4e7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:31.613718 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-eb08ac7c-a311-4e0e-b97e-93bc68fd9695 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:31.622317 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-eb08ac7c-a311-4e0e-b97e-93bc68fd9695 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1513 microversion: 2.1 time: 0.315004 May 25 15:48:31.622897 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 542/1097] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:31 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1513 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:31.646647 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b62b3a9d-9cc5-4b8e-98ac-5804c828e4e7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:31.655766 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b62b3a9d-9cc5-4b8e-98ac-5804c828e4e7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.232608 May 25 15:48:31.656372 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 556/1098] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:31 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:48:32.638431 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9d4b1e7d-f4f4-4f9f-9fde-66bb68bc27d6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:32.639251 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9d4b1e7d-f4f4-4f9f-9fde-66bb68bc27d6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:32.648146 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9d4b1e7d-f4f4-4f9f-9fde-66bb68bc27d6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:32.648641 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9d4b1e7d-f4f4-4f9f-9fde-66bb68bc27d6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:32.649433 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9d4b1e7d-f4f4-4f9f-9fde-66bb68bc27d6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:32.649880 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9d4b1e7d-f4f4-4f9f-9fde-66bb68bc27d6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:32.673294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ca0e81b0-75df-4387-bc3b-900cd66ea2d1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:32.674716 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ca0e81b0-75df-4387-bc3b-900cd66ea2d1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:32.682934 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca0e81b0-75df-4387-bc3b-900cd66ea2d1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:32.683887 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca0e81b0-75df-4387-bc3b-900cd66ea2d1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:32.685032 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca0e81b0-75df-4387-bc3b-900cd66ea2d1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:32.685699 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca0e81b0-75df-4387-bc3b-900cd66ea2d1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:32.865241 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9d4b1e7d-f4f4-4f9f-9fde-66bb68bc27d6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:32.875385 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9d4b1e7d-f4f4-4f9f-9fde-66bb68bc27d6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1513 microversion: 2.1 time: 0.240649 May 25 15:48:32.884768 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 543/1099] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:32 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:33.062861 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ca0e81b0-75df-4387-bc3b-900cd66ea2d1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:33.071362 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ca0e81b0-75df-4387-bc3b-900cd66ea2d1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.402370 May 25 15:48:33.072072 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 557/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:32 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:48:33.593730 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-568f0718-cd17-4700-a5a6-7ca3e6e6bcc1 req-bf41d7af-9477-4d7d-b8dd-3706209a1390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b386291d-3fac-42b5-86f8-f307a4a5dc0f", "name": "network-vif-deleted", "tag": "3def0d10-a624-4491-98d7-d5e621924663"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:48:33.595300 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:48:33.595300 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:48:33.603465 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-568f0718-cd17-4700-a5a6-7ca3e6e6bcc1 req-bf41d7af-9477-4d7d-b8dd-3706209a1390 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:33.603956 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-568f0718-cd17-4700-a5a6-7ca3e6e6bcc1 req-bf41d7af-9477-4d7d-b8dd-3706209a1390 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:33.621059 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-568f0718-cd17-4700-a5a6-7ca3e6e6bcc1 req-bf41d7af-9477-4d7d-b8dd-3706209a1390 service nova] Creating event network-vif-deleted:3def0d10-a624-4491-98d7-d5e621924663 for instance b386291d-3fac-42b5-86f8-f307a4a5dc0f on hv-cinder-79123 May 25 15:48:33.626889 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-568f0718-cd17-4700-a5a6-7ca3e6e6bcc1 req-bf41d7af-9477-4d7d-b8dd-3706209a1390 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036710 May 25 15:48:33.627991 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 544/1101] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:48:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:48:33.893191 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-483a28af-838b-4744-bf54-24a46fab7c12 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:33.893816 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-483a28af-838b-4744-bf54-24a46fab7c12 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:33.901373 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-483a28af-838b-4744-bf54-24a46fab7c12 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:33.901830 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-483a28af-838b-4744-bf54-24a46fab7c12 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:33.902603 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-483a28af-838b-4744-bf54-24a46fab7c12 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:33.903041 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-483a28af-838b-4744-bf54-24a46fab7c12 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:33.970058 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-483a28af-838b-4744-bf54-24a46fab7c12 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:33.970503 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-483a28af-838b-4744-bf54-24a46fab7c12 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:33.970952 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.objects.instance [None req-483a28af-838b-4744-bf54-24a46fab7c12 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lazy-loading 'fault' on Instance uuid b386291d-3fac-42b5-86f8-f307a4a5dc0f {{(pid=112577) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:48:34.045989 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-483a28af-838b-4744-bf54-24a46fab7c12 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a698a38cda4aa8827ed3bf664917f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:34.054313 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-483a28af-838b-4744-bf54-24a46fab7c12 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 200 len: 1308 microversion: 2.1 time: 0.165878 May 25 15:48:34.054881 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 558/1102] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:33 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:34.072969 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6156155f-a85e-432f-927a-12005d1af777 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:34.073569 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6156155f-a85e-432f-927a-12005d1af777 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:34.081662 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6156155f-a85e-432f-927a-12005d1af777 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:34.082123 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6156155f-a85e-432f-927a-12005d1af777 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:34.082910 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6156155f-a85e-432f-927a-12005d1af777 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:34.083362 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6156155f-a85e-432f-927a-12005d1af777 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:34.088505 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e2570ad6-bc48-4e7e-9b1c-8e6c7a9e668b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:34.089207 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e2570ad6-bc48-4e7e-9b1c-8e6c7a9e668b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:34.097196 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e2570ad6-bc48-4e7e-9b1c-8e6c7a9e668b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:34.097729 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e2570ad6-bc48-4e7e-9b1c-8e6c7a9e668b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:34.098517 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e2570ad6-bc48-4e7e-9b1c-8e6c7a9e668b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:34.098963 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-e2570ad6-bc48-4e7e-9b1c-8e6c7a9e668b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:34.132470 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-6156155f-a85e-432f-927a-12005d1af777 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] HTTP exception thrown: Instance 4b093877-20ab-4678-8d94-a89983bda325 could not be found. May 25 15:48:34.133094 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6156155f-a85e-432f-927a-12005d1af777 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Returning 404 to user: Instance 4b093877-20ab-4678-8d94-a89983bda325 could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:48:34.133966 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6156155f-a85e-432f-927a-12005d1af777 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 404 len: 111 microversion: 2.1 time: 0.065131 May 25 15:48:34.134513 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 545/1103] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:48:34 2021] DELETE /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:48:34.143092 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9739c546-6250-4f4b-a790-b29c4207ac3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:34.143723 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9739c546-6250-4f4b-a790-b29c4207ac3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 4b093877-20ab-4678-8d94-a89983bda325] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:34.151072 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9739c546-6250-4f4b-a790-b29c4207ac3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:34.151534 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9739c546-6250-4f4b-a790-b29c4207ac3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:34.152355 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9739c546-6250-4f4b-a790-b29c4207ac3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:34.152806 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9739c546-6250-4f4b-a790-b29c4207ac3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:34.203532 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-9739c546-6250-4f4b-a790-b29c4207ac3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] HTTP exception thrown: Instance 4b093877-20ab-4678-8d94-a89983bda325 could not be found. May 25 15:48:34.204185 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9739c546-6250-4f4b-a790-b29c4207ac3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Returning 404 to user: Instance 4b093877-20ab-4678-8d94-a89983bda325 could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:48:34.205047 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9739c546-6250-4f4b-a790-b29c4207ac3c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325" status: 404 len: 111 microversion: 2.1 time: 0.066495 May 25 15:48:34.205676 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 546/1104] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:34 2021] GET /compute/v2.1/servers/4b093877-20ab-4678-8d94-a89983bda325 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:48:34.309169 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e2570ad6-bc48-4e7e-9b1c-8e6c7a9e668b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:34.318703 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e2570ad6-bc48-4e7e-9b1c-8e6c7a9e668b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.233607 May 25 15:48:34.319209 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 559/1105] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:34 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:48:35.071437 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c6577308-f596-4ab9-98d6-ba8835faae72 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:35.072096 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c6577308-f596-4ab9-98d6-ba8835faae72 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] [instance: b386291d-3fac-42b5-86f8-f307a4a5dc0f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:35.080103 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c6577308-f596-4ab9-98d6-ba8835faae72 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:35.080700 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c6577308-f596-4ab9-98d6-ba8835faae72 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:35.081331 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c6577308-f596-4ab9-98d6-ba8835faae72 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:35.081777 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c6577308-f596-4ab9-98d6-ba8835faae72 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:35.129871 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-c6577308-f596-4ab9-98d6-ba8835faae72 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] HTTP exception thrown: Instance b386291d-3fac-42b5-86f8-f307a4a5dc0f could not be found. May 25 15:48:35.130474 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c6577308-f596-4ab9-98d6-ba8835faae72 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Returning 404 to user: Instance b386291d-3fac-42b5-86f8-f307a4a5dc0f could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:48:35.131309 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c6577308-f596-4ab9-98d6-ba8835faae72 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f" status: 404 len: 111 microversion: 2.1 time: 0.063606 May 25 15:48:35.131831 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 547/1106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:35 2021] GET /compute/v2.1/servers/b386291d-3fac-42b5-86f8-f307a4a5dc0f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:48:35.336524 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-41767800-f531-4ea6-b460-6b673237b1be tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:35.337083 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-41767800-f531-4ea6-b460-6b673237b1be tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:35.344911 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-41767800-f531-4ea6-b460-6b673237b1be tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:35.345375 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-41767800-f531-4ea6-b460-6b673237b1be tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:35.346167 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-41767800-f531-4ea6-b460-6b673237b1be tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:35.346619 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-41767800-f531-4ea6-b460-6b673237b1be tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:35.452506 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-880d68cc-287d-4274-ba1f-762df363256d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:35.453009 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-880d68cc-287d-4274-ba1f-762df363256d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:35.460530 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-880d68cc-287d-4274-ba1f-762df363256d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:35.460988 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-880d68cc-287d-4274-ba1f-762df363256d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:35.461761 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-880d68cc-287d-4274-ba1f-762df363256d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:35.462196 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-880d68cc-287d-4274-ba1f-762df363256d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:35.520634 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-880d68cc-287d-4274-ba1f-762df363256d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] HTTP exception thrown: Instance 92aed9d5-56b6-4cbf-9678-b16f7de68b23 could not be found. May 25 15:48:35.521241 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-880d68cc-287d-4274-ba1f-762df363256d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Returning 404 to user: Instance 92aed9d5-56b6-4cbf-9678-b16f7de68b23 could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:48:35.522265 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-880d68cc-287d-4274-ba1f-762df363256d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 404 len: 111 microversion: 2.1 time: 0.073887 May 25 15:48:35.523405 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 548/1107] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:48:35 2021] DELETE /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:48:35.531449 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4fdc7955-b14d-4a96-9598-3e38551d1596 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:35.532365 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4fdc7955-b14d-4a96-9598-3e38551d1596 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] [instance: 92aed9d5-56b6-4cbf-9678-b16f7de68b23] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:35.539768 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4fdc7955-b14d-4a96-9598-3e38551d1596 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:35.540272 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4fdc7955-b14d-4a96-9598-3e38551d1596 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:35.541079 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4fdc7955-b14d-4a96-9598-3e38551d1596 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:35.541572 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4fdc7955-b14d-4a96-9598-3e38551d1596 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:35.591157 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-41767800-f531-4ea6-b460-6b673237b1be tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:35.601454 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-41767800-f531-4ea6-b460-6b673237b1be tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.268735 May 25 15:48:35.602230 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 560/1108] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:35 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:35.602381 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-4fdc7955-b14d-4a96-9598-3e38551d1596 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] HTTP exception thrown: Instance 92aed9d5-56b6-4cbf-9678-b16f7de68b23 could not be found. May 25 15:48:35.602999 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4fdc7955-b14d-4a96-9598-3e38551d1596 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Returning 404 to user: Instance 92aed9d5-56b6-4cbf-9678-b16f7de68b23 could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:48:35.603867 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4fdc7955-b14d-4a96-9598-3e38551d1596 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23" status: 404 len: 111 microversion: 2.1 time: 0.076761 May 25 15:48:35.604507 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 549/1109] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:35 2021] GET /compute/v2.1/servers/92aed9d5-56b6-4cbf-9678-b16f7de68b23 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:48:36.618304 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d495807f-7176-4878-a55b-c9538bb9769b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:36.619015 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d495807f-7176-4878-a55b-c9538bb9769b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:36.627022 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d495807f-7176-4878-a55b-c9538bb9769b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:36.627553 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d495807f-7176-4878-a55b-c9538bb9769b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:36.628427 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d495807f-7176-4878-a55b-c9538bb9769b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:36.628933 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d495807f-7176-4878-a55b-c9538bb9769b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:36.847798 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d495807f-7176-4878-a55b-c9538bb9769b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:36.858004 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d495807f-7176-4878-a55b-c9538bb9769b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.242836 May 25 15:48:36.858979 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 561/1110] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:36 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:37.738859 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:48:37.739458 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: Tue May 25 15:48:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:48:37.874630 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c23ffef6-fb81-44ae-99a5-f81074740071 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:37.875257 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c23ffef6-fb81-44ae-99a5-f81074740071 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:37.882570 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c23ffef6-fb81-44ae-99a5-f81074740071 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:37.883031 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c23ffef6-fb81-44ae-99a5-f81074740071 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:37.883814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c23ffef6-fb81-44ae-99a5-f81074740071 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:37.884362 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c23ffef6-fb81-44ae-99a5-f81074740071 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:38.198081 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c23ffef6-fb81-44ae-99a5-f81074740071 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:38.208737 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c23ffef6-fb81-44ae-99a5-f81074740071 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.337846 May 25 15:48:38.209494 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 550/1111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:37 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:39.226289 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-250bcce4-3068-447b-bbf9-cf05c60bcaba tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:39.227010 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-250bcce4-3068-447b-bbf9-cf05c60bcaba tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:39.238684 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-250bcce4-3068-447b-bbf9-cf05c60bcaba tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:39.238684 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-250bcce4-3068-447b-bbf9-cf05c60bcaba tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:39.238684 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-250bcce4-3068-447b-bbf9-cf05c60bcaba tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:39.238684 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-250bcce4-3068-447b-bbf9-cf05c60bcaba tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:39.666752 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-250bcce4-3068-447b-bbf9-cf05c60bcaba tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:39.677560 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-250bcce4-3068-447b-bbf9-cf05c60bcaba tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.455172 May 25 15:48:39.678151 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 562/1112] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:39 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:40.694628 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-fdb0cce5-cd20-49a3-a7da-8fe93dff731e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:40.695328 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-fdb0cce5-cd20-49a3-a7da-8fe93dff731e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:40.703604 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fdb0cce5-cd20-49a3-a7da-8fe93dff731e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:40.704054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fdb0cce5-cd20-49a3-a7da-8fe93dff731e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:40.704876 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fdb0cce5-cd20-49a3-a7da-8fe93dff731e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:40.705347 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fdb0cce5-cd20-49a3-a7da-8fe93dff731e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:40.927331 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-fdb0cce5-cd20-49a3-a7da-8fe93dff731e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:40.936299 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-fdb0cce5-cd20-49a3-a7da-8fe93dff731e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.244999 May 25 15:48:40.936868 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 551/1113] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:40 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:41.952751 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d1d50d5f-11f3-4ebd-abb4-abddd30e890e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:41.953411 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d1d50d5f-11f3-4ebd-abb4-abddd30e890e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:41.960714 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1d50d5f-11f3-4ebd-abb4-abddd30e890e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:41.961173 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1d50d5f-11f3-4ebd-abb4-abddd30e890e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:41.961976 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1d50d5f-11f3-4ebd-abb4-abddd30e890e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:41.962402 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1d50d5f-11f3-4ebd-abb4-abddd30e890e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:42.181082 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d1d50d5f-11f3-4ebd-abb4-abddd30e890e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:42.191210 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d1d50d5f-11f3-4ebd-abb4-abddd30e890e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.242199 May 25 15:48:42.192003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 563/1114] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:41 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:43.090773 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-7b221bd9-a76b-426b-b6c6-a5f1cadedb74 req-cac3339c-1018-431d-a5fc-b9cf89eadeb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b8d3b0-aceb-4f56-a13d-7d0696f42901", "name": "network-vif-plugged", "status": "completed", "tag": "7ae06ec7-6469-494a-b223-ce3de0a0e2da"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:48:43.093134 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:48:43.093134 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:48:43.103120 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-7b221bd9-a76b-426b-b6c6-a5f1cadedb74 req-cac3339c-1018-431d-a5fc-b9cf89eadeb6 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:43.103717 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-7b221bd9-a76b-426b-b6c6-a5f1cadedb74 req-cac3339c-1018-431d-a5fc-b9cf89eadeb6 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:43.121610 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-7b221bd9-a76b-426b-b6c6-a5f1cadedb74 req-cac3339c-1018-431d-a5fc-b9cf89eadeb6 service nova] Creating event network-vif-plugged:7ae06ec7-6469-494a-b223-ce3de0a0e2da for instance a4b8d3b0-aceb-4f56-a13d-7d0696f42901 on hv-cinder-79123 May 25 15:48:43.127358 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-7b221bd9-a76b-426b-b6c6-a5f1cadedb74 req-cac3339c-1018-431d-a5fc-b9cf89eadeb6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040426 May 25 15:48:43.128466 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 552/1115] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:48:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:48:43.209137 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3dbfb272-6b15-4efa-9998-ed291cd2c547 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:43.209758 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3dbfb272-6b15-4efa-9998-ed291cd2c547 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:43.217708 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3dbfb272-6b15-4efa-9998-ed291cd2c547 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:43.218161 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3dbfb272-6b15-4efa-9998-ed291cd2c547 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:43.218934 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3dbfb272-6b15-4efa-9998-ed291cd2c547 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:43.219398 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3dbfb272-6b15-4efa-9998-ed291cd2c547 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:43.486291 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-3dbfb272-6b15-4efa-9998-ed291cd2c547 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:43.501315 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3dbfb272-6b15-4efa-9998-ed291cd2c547 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.295792 May 25 15:48:43.502533 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 564/1116] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:43 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:43.758509 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1621947533", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "networks": [{"uuid": "247feda9-7b6d-4c87-abaf-0b9c5d89f2d3"}]}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:48:43.837996 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.network.neutron [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] validate_networks() for [('247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', None, None, None)] {{(pid=112576) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:48:44.366906 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Flavor limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:48:44.367485 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Image limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:48:44.367836 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Flavor pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:48:44.368287 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Image pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:48:44.368701 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:48:44.377014 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:44.377464 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:44.378259 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:44.378694 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:44.397320 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Getting quotas for project 6e1f97f6101d466a9c224075352387d8. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:48:44.401293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Getting quotas for user be4361d882e741fe993a2856b105ae74 and project 6e1f97f6101d466a9c224075352387d8. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:48:44.412836 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Going to run 1 instances... {{(pid=112576) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:48:44.415235 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112576) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:48:44.458698 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-aea0f46f-2309-441a-81f1-8d8e021f89ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820721 May 25 15:48:44.459335 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 553/1117] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:48:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 15:48:44.469735 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-e0015906-3531-4fc2-b4e8-e347f47ec2df tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:44.470363 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-e0015906-3531-4fc2-b4e8-e347f47ec2df tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:44.519313 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9047c17f-27bf-4b60-8850-1bb69a1ba039 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:44.520115 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9047c17f-27bf-4b60-8850-1bb69a1ba039 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:44.528193 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9047c17f-27bf-4b60-8850-1bb69a1ba039 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:44.528684 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9047c17f-27bf-4b60-8850-1bb69a1ba039 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:44.530209 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9047c17f-27bf-4b60-8850-1bb69a1ba039 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:44.530663 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9047c17f-27bf-4b60-8850-1bb69a1ba039 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:44.547529 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-e0015906-3531-4fc2-b4e8-e347f47ec2df tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:44.557036 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-e0015906-3531-4fc2-b4e8-e347f47ec2df tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1218 microversion: 2.1 time: 0.091701 May 25 15:48:44.559891 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 565/1118] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:44 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:44.745130 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9047c17f-27bf-4b60-8850-1bb69a1ba039 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:44.754832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9047c17f-27bf-4b60-8850-1bb69a1ba039 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1576 microversion: 2.1 time: 0.239624 May 25 15:48:44.766273 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 554/1119] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:44 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1576 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:48:45.574527 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9b943e1b-8a95-4404-9f3e-2ca19582fedb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:45.575237 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9b943e1b-8a95-4404-9f3e-2ca19582fedb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:45.584175 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b943e1b-8a95-4404-9f3e-2ca19582fedb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:45.584636 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b943e1b-8a95-4404-9f3e-2ca19582fedb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:45.585421 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b943e1b-8a95-4404-9f3e-2ca19582fedb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:45.585865 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9b943e1b-8a95-4404-9f3e-2ca19582fedb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:45.723569 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9b943e1b-8a95-4404-9f3e-2ca19582fedb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:45.732162 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9b943e1b-8a95-4404-9f3e-2ca19582fedb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1270 microversion: 2.1 time: 0.161628 May 25 15:48:45.732732 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 566/1120] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:45 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:45.773547 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-82e990bc-2577-4099-beac-54c4b25b5ab0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:45.774111 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-82e990bc-2577-4099-beac-54c4b25b5ab0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:45.781407 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-82e990bc-2577-4099-beac-54c4b25b5ab0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:45.781866 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-82e990bc-2577-4099-beac-54c4b25b5ab0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:45.782645 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-82e990bc-2577-4099-beac-54c4b25b5ab0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:45.783078 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-82e990bc-2577-4099-beac-54c4b25b5ab0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:46.006081 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-82e990bc-2577-4099-beac-54c4b25b5ab0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:46.014881 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-82e990bc-2577-4099-beac-54c4b25b5ab0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1563 microversion: 2.1 time: 0.245766 May 25 15:48:46.015747 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 555/1121] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:45 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:46.750442 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-76e2cd42-e37d-4634-a83c-59234b14a6a6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:46.751226 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-76e2cd42-e37d-4634-a83c-59234b14a6a6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:46.758631 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-76e2cd42-e37d-4634-a83c-59234b14a6a6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:46.759253 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-76e2cd42-e37d-4634-a83c-59234b14a6a6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:46.760202 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-76e2cd42-e37d-4634-a83c-59234b14a6a6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:46.760747 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-76e2cd42-e37d-4634-a83c-59234b14a6a6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:47.209236 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-76e2cd42-e37d-4634-a83c-59234b14a6a6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:47.217408 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-76e2cd42-e37d-4634-a83c-59234b14a6a6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1318 microversion: 2.1 time: 0.472080 May 25 15:48:47.217980 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 567/1122] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:46 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:47.728425 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-244f6ac3-215e-4c1c-b746-73c2ad59e009 req-741f9892-160d-4aa7-8711-8c2cdd3d8735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef24ea0-a934-410a-8440-614ba104efd6", "tag": "03200337-3a8d-470d-b921-cf873c06c54e"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:48:47.730019 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:48:47.730019 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:48:47.738853 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-244f6ac3-215e-4c1c-b746-73c2ad59e009 req-741f9892-160d-4aa7-8711-8c2cdd3d8735 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:47.739303 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-244f6ac3-215e-4c1c-b746-73c2ad59e009 req-741f9892-160d-4aa7-8711-8c2cdd3d8735 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:47.754975 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-244f6ac3-215e-4c1c-b746-73c2ad59e009 req-741f9892-160d-4aa7-8711-8c2cdd3d8735 service nova] Creating event network-changed:03200337-3a8d-470d-b921-cf873c06c54e for instance fef24ea0-a934-410a-8440-614ba104efd6 on hv-cinder-79123 May 25 15:48:47.759395 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-244f6ac3-215e-4c1c-b746-73c2ad59e009 req-741f9892-160d-4aa7-8711-8c2cdd3d8735 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034590 May 25 15:48:47.759993 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 556/1123] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:48:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:48:48.234397 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a4802a7f-02e8-48fb-a5ee-251eaac54de5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:48.235097 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a4802a7f-02e8-48fb-a5ee-251eaac54de5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:48.242511 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a4802a7f-02e8-48fb-a5ee-251eaac54de5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:48.242971 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a4802a7f-02e8-48fb-a5ee-251eaac54de5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:48.243753 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a4802a7f-02e8-48fb-a5ee-251eaac54de5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:48.244381 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a4802a7f-02e8-48fb-a5ee-251eaac54de5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:48.448746 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a4802a7f-02e8-48fb-a5ee-251eaac54de5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:48.458311 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a4802a7f-02e8-48fb-a5ee-251eaac54de5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1318 microversion: 2.1 time: 0.227823 May 25 15:48:48.459001 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 568/1124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:48 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:49.475205 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b479bf39-9ab3-4213-acd4-7b02f5d95955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:49.475952 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b479bf39-9ab3-4213-acd4-7b02f5d95955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:49.484097 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b479bf39-9ab3-4213-acd4-7b02f5d95955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:49.484566 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b479bf39-9ab3-4213-acd4-7b02f5d95955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:49.485346 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b479bf39-9ab3-4213-acd4-7b02f5d95955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:49.485791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b479bf39-9ab3-4213-acd4-7b02f5d95955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:49.704060 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b479bf39-9ab3-4213-acd4-7b02f5d95955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:49.712378 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b479bf39-9ab3-4213-acd4-7b02f5d95955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1318 microversion: 2.1 time: 0.241345 May 25 15:48:49.712953 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 557/1125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:49 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:48:50.729620 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2ef5c8ae-192a-48b6-a6f4-3e6234ec35e5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:50.730284 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2ef5c8ae-192a-48b6-a6f4-3e6234ec35e5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:50.738160 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2ef5c8ae-192a-48b6-a6f4-3e6234ec35e5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:50.738622 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2ef5c8ae-192a-48b6-a6f4-3e6234ec35e5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:50.739414 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2ef5c8ae-192a-48b6-a6f4-3e6234ec35e5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:50.739876 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2ef5c8ae-192a-48b6-a6f4-3e6234ec35e5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:51.195378 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2ef5c8ae-192a-48b6-a6f4-3e6234ec35e5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:51.204426 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2ef5c8ae-192a-48b6-a6f4-3e6234ec35e5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1318 microversion: 2.1 time: 0.478526 May 25 15:48:51.213042 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 569/1126] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:50 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:52.223293 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-544302b1-6c82-4218-b767-3b94ada7c7a2 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:52.224242 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-544302b1-6c82-4218-b767-3b94ada7c7a2 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:52.233089 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-544302b1-6c82-4218-b767-3b94ada7c7a2 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:52.233545 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-544302b1-6c82-4218-b767-3b94ada7c7a2 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:52.234321 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-544302b1-6c82-4218-b767-3b94ada7c7a2 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:52.234769 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-544302b1-6c82-4218-b767-3b94ada7c7a2 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:52.427489 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-544302b1-6c82-4218-b767-3b94ada7c7a2 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:52.435905 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-544302b1-6c82-4218-b767-3b94ada7c7a2 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1318 microversion: 2.1 time: 0.217721 May 25 15:48:52.436509 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 558/1127] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:52 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:53.453593 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fdb89dd6-f0ce-4737-bb7e-7c7be9ab4e70 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:53.454252 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fdb89dd6-f0ce-4737-bb7e-7c7be9ab4e70 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:53.461826 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fdb89dd6-f0ce-4737-bb7e-7c7be9ab4e70 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:53.462288 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fdb89dd6-f0ce-4737-bb7e-7c7be9ab4e70 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:53.464095 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fdb89dd6-f0ce-4737-bb7e-7c7be9ab4e70 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:53.464902 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fdb89dd6-f0ce-4737-bb7e-7c7be9ab4e70 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:53.671156 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-fdb89dd6-f0ce-4737-bb7e-7c7be9ab4e70 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:53.679425 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fdb89dd6-f0ce-4737-bb7e-7c7be9ab4e70 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1318 microversion: 2.1 time: 0.230632 May 25 15:48:53.680029 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 570/1128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:53 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:54.696727 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1b9f2656-8c33-4f8c-bf54-b599898cc3cd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:54.697384 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1b9f2656-8c33-4f8c-bf54-b599898cc3cd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:54.705325 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1b9f2656-8c33-4f8c-bf54-b599898cc3cd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:54.705785 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1b9f2656-8c33-4f8c-bf54-b599898cc3cd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:54.706596 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1b9f2656-8c33-4f8c-bf54-b599898cc3cd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:54.707044 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1b9f2656-8c33-4f8c-bf54-b599898cc3cd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:55.043945 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1b9f2656-8c33-4f8c-bf54-b599898cc3cd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:55.052543 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1b9f2656-8c33-4f8c-bf54-b599898cc3cd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1318 microversion: 2.1 time: 0.359579 May 25 15:48:55.053107 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 559/1129] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:54 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:55.713731 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-39ba5b19-a703-4629-9e37-a0c57c5b6a28 req-35aaf79f-b8b1-4655-8fcc-f6d8a6fdbffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef24ea0-a934-410a-8440-614ba104efd6", "name": "network-vif-plugged", "status": "completed", "tag": "03200337-3a8d-470d-b921-cf873c06c54e"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:48:55.715466 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:48:55.715466 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:48:55.724101 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-39ba5b19-a703-4629-9e37-a0c57c5b6a28 req-35aaf79f-b8b1-4655-8fcc-f6d8a6fdbffc service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:55.724575 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-39ba5b19-a703-4629-9e37-a0c57c5b6a28 req-35aaf79f-b8b1-4655-8fcc-f6d8a6fdbffc service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:55.741207 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-39ba5b19-a703-4629-9e37-a0c57c5b6a28 req-35aaf79f-b8b1-4655-8fcc-f6d8a6fdbffc service nova] Creating event network-vif-plugged:03200337-3a8d-470d-b921-cf873c06c54e for instance fef24ea0-a934-410a-8440-614ba104efd6 on hv-cinder-79123 May 25 15:48:55.745951 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-39ba5b19-a703-4629-9e37-a0c57c5b6a28 req-35aaf79f-b8b1-4655-8fcc-f6d8a6fdbffc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036698 May 25 15:48:55.746544 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 571/1130] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:48:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:48:56.069530 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b719826a-a0bc-4c1d-ae15-aac6a333fe67 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:56.070102 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b719826a-a0bc-4c1d-ae15-aac6a333fe67 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:56.077429 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b719826a-a0bc-4c1d-ae15-aac6a333fe67 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:56.077888 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b719826a-a0bc-4c1d-ae15-aac6a333fe67 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:56.078668 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b719826a-a0bc-4c1d-ae15-aac6a333fe67 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:56.079115 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b719826a-a0bc-4c1d-ae15-aac6a333fe67 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:56.270598 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b719826a-a0bc-4c1d-ae15-aac6a333fe67 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:56.278778 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b719826a-a0bc-4c1d-ae15-aac6a333fe67 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1318 microversion: 2.1 time: 0.213050 May 25 15:48:56.279839 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 560/1131] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:56 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:57.296649 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-35d66e1f-c588-4c13-a457-36dfe3a63b4b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:48:57.297641 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-35d66e1f-c588-4c13-a457-36dfe3a63b4b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:57.305170 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-35d66e1f-c588-4c13-a457-36dfe3a63b4b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:57.305634 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-35d66e1f-c588-4c13-a457-36dfe3a63b4b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:57.306420 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-35d66e1f-c588-4c13-a457-36dfe3a63b4b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:57.306865 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-35d66e1f-c588-4c13-a457-36dfe3a63b4b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:57.525377 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-35d66e1f-c588-4c13-a457-36dfe3a63b4b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:48:57.533865 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-35d66e1f-c588-4c13-a457-36dfe3a63b4b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1508 microversion: 2.1 time: 0.241410 May 25 15:48:57.534443 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 572/1132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:48:57 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:48:59.124257 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-fc821b8c-69b0-4873-8074-5f9a235fb386 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40adee2b-0868-4781-a959-2c80e871e523"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:48:59.125315 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-fc821b8c-69b0-4873-8074-5f9a235fb386 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:48:59.132537 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fc821b8c-69b0-4873-8074-5f9a235fb386 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:59.132990 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fc821b8c-69b0-4873-8074-5f9a235fb386 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:59.133756 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fc821b8c-69b0-4873-8074-5f9a235fb386 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:59.134192 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-fc821b8c-69b0-4873-8074-5f9a235fb386 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:59.504764 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-fc821b8c-69b0-4873-8074-5f9a235fb386 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "POST /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384577 May 25 15:48:59.505364 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 561/1133] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:48:59 2021] POST /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:49:04.885539 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d9bbafe3-699a-44bc-ab29-13a85c5526ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:04.886048 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d9bbafe3-699a-44bc-ab29-13a85c5526ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:04.893639 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d9bbafe3-699a-44bc-ab29-13a85c5526ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:04.894092 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d9bbafe3-699a-44bc-ab29-13a85c5526ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:04.894890 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d9bbafe3-699a-44bc-ab29-13a85c5526ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:04.895328 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d9bbafe3-699a-44bc-ab29-13a85c5526ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:04.954687 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d9bbafe3-699a-44bc-ab29-13a85c5526ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Going to try to terminate instance {{(pid=112577) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:49:05.071294 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d9bbafe3-699a-44bc-ab29-13a85c5526ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 204 len: 0 microversion: 2.20 time: 0.189038 May 25 15:49:05.072092 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 573/1134] 10.222.0.36 () {60 vars in 1280 bytes} [Tue May 25 15:49:04 2021] DELETE /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 15:49:05.081558 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7bae662f-477d-4f5c-8d6e-a78a39114654 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:05.082271 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7bae662f-477d-4f5c-8d6e-a78a39114654 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:05.090397 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7bae662f-477d-4f5c-8d6e-a78a39114654 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:05.090860 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7bae662f-477d-4f5c-8d6e-a78a39114654 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:05.091635 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7bae662f-477d-4f5c-8d6e-a78a39114654 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:05.092609 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7bae662f-477d-4f5c-8d6e-a78a39114654 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:05.289875 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7bae662f-477d-4f5c-8d6e-a78a39114654 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:05.299237 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7bae662f-477d-4f5c-8d6e-a78a39114654 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:05.300790 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7bae662f-477d-4f5c-8d6e-a78a39114654 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:05.301942 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7bae662f-477d-4f5c-8d6e-a78a39114654 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.225115 May 25 15:49:05.302498 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 562/1135] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:49:05 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:49:06.320342 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1aa54f28-3cda-4509-baf2-d1761b68d338 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:06.321060 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1aa54f28-3cda-4509-baf2-d1761b68d338 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:06.328506 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1aa54f28-3cda-4509-baf2-d1761b68d338 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:06.328964 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1aa54f28-3cda-4509-baf2-d1761b68d338 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:06.329748 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1aa54f28-3cda-4509-baf2-d1761b68d338 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:06.330194 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1aa54f28-3cda-4509-baf2-d1761b68d338 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:06.534445 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1aa54f28-3cda-4509-baf2-d1761b68d338 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:06.543199 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1aa54f28-3cda-4509-baf2-d1761b68d338 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:06.544744 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1aa54f28-3cda-4509-baf2-d1761b68d338 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:06.546476 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1aa54f28-3cda-4509-baf2-d1761b68d338 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.230640 May 25 15:49:06.547036 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 574/1136] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:49:06 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:49:07.369277 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-254300047", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "networks": [{"uuid": "247feda9-7b6d-4c87-abaf-0b9c5d89f2d3"}]}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:07.437606 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.network.neutron [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] validate_networks() for [('247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', None, None, None)] {{(pid=112576) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:49:07.565541 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:07.566780 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:07.573912 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:07.574366 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:07.575148 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:07.575588 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:07.921098 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:07.929955 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:07.931516 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:07.933096 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1723 microversion: 2.20 time: 0.371351 May 25 15:49:07.933667 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 575/1137] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:49:07 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:49:07.973196 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Flavor limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:49:07.973638 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Image limits 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:49:07.974126 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Flavor pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:49:07.974580 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Image pref 0:0:0 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:49:07.975002 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.virt.hardware [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112576) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:49:07.984239 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:07.984702 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:07.985553 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:07.986002 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:08.003415 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Getting quotas for project 6e1f97f6101d466a9c224075352387d8. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:49:08.007505 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.quota [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Getting quotas for user be4361d882e741fe993a2856b105ae74 and project 6e1f97f6101d466a9c224075352387d8. Resources: {'instances', 'ram', 'cores'} {{(pid=112576) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:49:08.018524 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Going to run 1 instances... {{(pid=112576) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:49:08.020865 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112576) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:49:08.066370 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700660 May 25 15:49:08.067373 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 563/1138] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:49:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:49:08.077703 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-cc68b863-d411-4832-b98f-5cfa4c145df0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:08.078455 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-cc68b863-d411-4832-b98f-5cfa4c145df0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:08.252896 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-cc68b863-d411-4832-b98f-5cfa4c145df0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:08.260859 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-cc68b863-d411-4832-b98f-5cfa4c145df0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1217 microversion: 2.1 time: 0.187689 May 25 15:49:08.261489 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 576/1139] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:08 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1217 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:08.954156 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-efba7eed-a73c-4151-b34c-ec74eb3983db tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:08.954791 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-efba7eed-a73c-4151-b34c-ec74eb3983db tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:08.962427 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-efba7eed-a73c-4151-b34c-ec74eb3983db tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:08.963147 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-efba7eed-a73c-4151-b34c-ec74eb3983db tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:08.964164 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-efba7eed-a73c-4151-b34c-ec74eb3983db tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:08.964763 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-efba7eed-a73c-4151-b34c-ec74eb3983db tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:09.025181 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-f67e5f61-6691-4291-8b7a-947041934c58 req-4f0b8e1b-1f48-43ca-94be-0a8a5083cbb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c657feea-6b2e-48ce-a311-464e6b956e0e", "name": "network-vif-deleted", "tag": "8c3b5d16-b63c-438e-a031-8606d9e7796f"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:09.036990 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:49:09.036990 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:49:09.056947 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-f67e5f61-6691-4291-8b7a-947041934c58 req-4f0b8e1b-1f48-43ca-94be-0a8a5083cbb9 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:09.057474 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-f67e5f61-6691-4291-8b7a-947041934c58 req-4f0b8e1b-1f48-43ca-94be-0a8a5083cbb9 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:09.076945 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-f67e5f61-6691-4291-8b7a-947041934c58 req-4f0b8e1b-1f48-43ca-94be-0a8a5083cbb9 service nova] Creating event network-vif-deleted:8c3b5d16-b63c-438e-a031-8606d9e7796f for instance c657feea-6b2e-48ce-a311-464e6b956e0e on hv-cinder-79123 May 25 15:49:09.082622 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-f67e5f61-6691-4291-8b7a-947041934c58 req-4f0b8e1b-1f48-43ca-94be-0a8a5083cbb9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062240 May 25 15:49:09.083230 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 577/1140] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:49:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:49:09.092987 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-efba7eed-a73c-4151-b34c-ec74eb3983db tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:09.102346 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-efba7eed-a73c-4151-b34c-ec74eb3983db tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:09.109423 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-efba7eed-a73c-4151-b34c-ec74eb3983db tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c8848f72ab74290b58ed881102d153e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:09.111143 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-efba7eed-a73c-4151-b34c-ec74eb3983db tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 200 len: 1655 microversion: 2.20 time: 0.164485 May 25 15:49:09.111704 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 564/1141] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:49:08 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 1655 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:49:09.278798 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-80b12db9-ef53-436a-a976-00bf858eb024 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:09.282185 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-80b12db9-ef53-436a-a976-00bf858eb024 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:09.290106 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-80b12db9-ef53-436a-a976-00bf858eb024 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:09.290576 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-80b12db9-ef53-436a-a976-00bf858eb024 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:09.291372 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-80b12db9-ef53-436a-a976-00bf858eb024 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:09.291825 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-80b12db9-ef53-436a-a976-00bf858eb024 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:09.421899 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-80b12db9-ef53-436a-a976-00bf858eb024 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:09.439729 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-80b12db9-ef53-436a-a976-00bf858eb024 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1277 microversion: 2.1 time: 0.165123 May 25 15:49:09.440765 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 578/1142] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:09 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:10.130468 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-85ae8b92-34e2-46b4-929d-7d8b17509ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:10.131370 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-85ae8b92-34e2-46b4-929d-7d8b17509ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:10.139524 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85ae8b92-34e2-46b4-929d-7d8b17509ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:10.140111 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85ae8b92-34e2-46b4-929d-7d8b17509ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:10.141254 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85ae8b92-34e2-46b4-929d-7d8b17509ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:10.141797 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85ae8b92-34e2-46b4-929d-7d8b17509ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:10.194119 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-85ae8b92-34e2-46b4-929d-7d8b17509ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] HTTP exception thrown: Instance c657feea-6b2e-48ce-a311-464e6b956e0e could not be found. May 25 15:49:10.194766 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-85ae8b92-34e2-46b4-929d-7d8b17509ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Returning 404 to user: Instance c657feea-6b2e-48ce-a311-464e6b956e0e could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:49:10.195621 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-85ae8b92-34e2-46b4-929d-7d8b17509ee6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 404 len: 111 microversion: 2.20 time: 0.069264 May 25 15:49:10.196530 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 565/1143] 10.222.0.36 () {60 vars in 1277 bytes} [Tue May 25 15:49:10 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:49:10.204717 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8edb7b73-7a03-4799-b8a5-7baadcafba9d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '.version_select at 0x7f088463c700>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:10.226148 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8edb7b73-7a03-4799-b8a5-7baadcafba9d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061766597" status: 204 len: 0 microversion: 2.20 time: 0.025039 May 25 15:49:10.226991 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 579/1144] 10.222.0.36 () {60 vars in 1262 bytes} [Tue May 25 15:49:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061766597 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 25 15:49:10.456723 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-51ef2d94-28bb-4d1f-b630-0a200513f991 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:10.457307 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-51ef2d94-28bb-4d1f-b630-0a200513f991 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:10.464955 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-51ef2d94-28bb-4d1f-b630-0a200513f991 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:10.465415 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-51ef2d94-28bb-4d1f-b630-0a200513f991 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:10.466502 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-51ef2d94-28bb-4d1f-b630-0a200513f991 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:10.467397 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-51ef2d94-28bb-4d1f-b630-0a200513f991 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:11.027316 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-51ef2d94-28bb-4d1f-b630-0a200513f991 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:11.036107 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-51ef2d94-28bb-4d1f-b630-0a200513f991 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1317 microversion: 2.1 time: 0.582983 May 25 15:49:11.037223 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 566/1145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:10 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:11.437976 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-aa4f3f88-c952-4371-973b-9763077619aa req-92599e23-3069-4d55-a57f-d3a0db34697f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c381c82c-5123-4915-b9b2-8f65b8ffaf9b", "tag": "6fd10c0b-7953-4682-8b93-6b38d31fbca5"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:11.440363 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:49:11.440363 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:49:11.451571 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-aa4f3f88-c952-4371-973b-9763077619aa req-92599e23-3069-4d55-a57f-d3a0db34697f service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:11.452212 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-aa4f3f88-c952-4371-973b-9763077619aa req-92599e23-3069-4d55-a57f-d3a0db34697f service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:11.477989 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-aa4f3f88-c952-4371-973b-9763077619aa req-92599e23-3069-4d55-a57f-d3a0db34697f service nova] Creating event network-changed:6fd10c0b-7953-4682-8b93-6b38d31fbca5 for instance c381c82c-5123-4915-b9b2-8f65b8ffaf9b on hv-cinder-79123 May 25 15:49:11.482775 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-aa4f3f88-c952-4371-973b-9763077619aa req-92599e23-3069-4d55-a57f-d3a0db34697f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048614 May 25 15:49:11.483382 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 580/1146] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:49:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:49:12.054114 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7a1389db-33b8-4ad4-af27-5eb12167be49 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:12.054749 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7a1389db-33b8-4ad4-af27-5eb12167be49 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:12.063583 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7a1389db-33b8-4ad4-af27-5eb12167be49 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:12.064075 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7a1389db-33b8-4ad4-af27-5eb12167be49 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:12.064873 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7a1389db-33b8-4ad4-af27-5eb12167be49 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:12.065362 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7a1389db-33b8-4ad4-af27-5eb12167be49 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:12.269023 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7a1389db-33b8-4ad4-af27-5eb12167be49 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:12.277198 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7a1389db-33b8-4ad4-af27-5eb12167be49 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1317 microversion: 2.1 time: 0.227384 May 25 15:49:12.277756 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 567/1147] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:12 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:12.758708 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4d3615f0-75ff-439a-ad18-7c2a9b606457 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:12.759309 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4d3615f0-75ff-439a-ad18-7c2a9b606457 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:12.767188 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4d3615f0-75ff-439a-ad18-7c2a9b606457 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:12.767655 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4d3615f0-75ff-439a-ad18-7c2a9b606457 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:12.768477 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4d3615f0-75ff-439a-ad18-7c2a9b606457 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:12.768926 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4d3615f0-75ff-439a-ad18-7c2a9b606457 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:12.818895 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-4d3615f0-75ff-439a-ad18-7c2a9b606457 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] HTTP exception thrown: Instance c657feea-6b2e-48ce-a311-464e6b956e0e could not be found. May 25 15:49:12.819498 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4d3615f0-75ff-439a-ad18-7c2a9b606457 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Returning 404 to user: Instance c657feea-6b2e-48ce-a311-464e6b956e0e could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:49:12.820390 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4d3615f0-75ff-439a-ad18-7c2a9b606457 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 404 len: 111 microversion: 2.1 time: 0.065881 May 25 15:49:12.821143 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 581/1148] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:49:12 2021] DELETE /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:49:12.829547 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ce5c588e-14f2-475c-8a54-43301618a6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:12.830170 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ce5c588e-14f2-475c-8a54-43301618a6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: c657feea-6b2e-48ce-a311-464e6b956e0e] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:12.837387 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ce5c588e-14f2-475c-8a54-43301618a6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:12.837850 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ce5c588e-14f2-475c-8a54-43301618a6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:12.838623 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ce5c588e-14f2-475c-8a54-43301618a6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:12.839236 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ce5c588e-14f2-475c-8a54-43301618a6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:12.888955 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-ce5c588e-14f2-475c-8a54-43301618a6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] HTTP exception thrown: Instance c657feea-6b2e-48ce-a311-464e6b956e0e could not be found. May 25 15:49:12.889555 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ce5c588e-14f2-475c-8a54-43301618a6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Returning 404 to user: Instance c657feea-6b2e-48ce-a311-464e6b956e0e could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:49:12.890394 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ce5c588e-14f2-475c-8a54-43301618a6eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e" status: 404 len: 111 microversion: 2.1 time: 0.065216 May 25 15:49:12.891539 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 568/1149] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:12 2021] GET /compute/v2.1/servers/c657feea-6b2e-48ce-a311-464e6b956e0e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:49:13.294456 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:13.295102 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:13.302516 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:13.303045 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:13.303944 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:13.304387 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:13.524157 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:13.532311 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1317 microversion: 2.1 time: 0.242049 May 25 15:49:13.532891 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 582/1150] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:13 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:14.118619 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-71710773-9972-458f-b4ee-62086bf6a569 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:14.119136 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-71710773-9972-458f-b4ee-62086bf6a569 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:14.126968 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-71710773-9972-458f-b4ee-62086bf6a569 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:14.127375 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-71710773-9972-458f-b4ee-62086bf6a569 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:14.128184 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-71710773-9972-458f-b4ee-62086bf6a569 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:14.128633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-71710773-9972-458f-b4ee-62086bf6a569 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:14.177072 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-71710773-9972-458f-b4ee-62086bf6a569 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] HTTP exception thrown: Instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb could not be found. May 25 15:49:14.177681 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-71710773-9972-458f-b4ee-62086bf6a569 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Returning 404 to user: Instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:49:14.178535 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-71710773-9972-458f-b4ee-62086bf6a569 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 404 len: 111 microversion: 2.1 time: 0.063595 May 25 15:49:14.179067 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 569/1151] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:49:14 2021] DELETE /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:49:14.187389 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c053bc4b-50e4-40c6-a6df-e3738e30cefe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:14.188076 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c053bc4b-50e4-40c6-a6df-e3738e30cefe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] [instance: 9301f1db-ecb0-465b-858c-64a2bfd4d5cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:14.195368 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c053bc4b-50e4-40c6-a6df-e3738e30cefe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:14.195827 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c053bc4b-50e4-40c6-a6df-e3738e30cefe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:14.196633 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c053bc4b-50e4-40c6-a6df-e3738e30cefe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:14.197078 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c053bc4b-50e4-40c6-a6df-e3738e30cefe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:14.251089 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-c053bc4b-50e4-40c6-a6df-e3738e30cefe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] HTTP exception thrown: Instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb could not be found. May 25 15:49:14.251695 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c053bc4b-50e4-40c6-a6df-e3738e30cefe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Returning 404 to user: Instance 9301f1db-ecb0-465b-858c-64a2bfd4d5cb could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:49:14.252557 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c053bc4b-50e4-40c6-a6df-e3738e30cefe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb" status: 404 len: 111 microversion: 2.1 time: 0.069528 May 25 15:49:14.253125 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 583/1152] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:14 2021] GET /compute/v2.1/servers/9301f1db-ecb0-465b-858c-64a2bfd4d5cb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:49:14.548600 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d3d76d69-5fa6-4a6f-a082-c86a6a690d87 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:14.549335 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d3d76d69-5fa6-4a6f-a082-c86a6a690d87 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:14.556960 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d3d76d69-5fa6-4a6f-a082-c86a6a690d87 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:14.557493 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d3d76d69-5fa6-4a6f-a082-c86a6a690d87 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:14.558358 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d3d76d69-5fa6-4a6f-a082-c86a6a690d87 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:14.558804 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d3d76d69-5fa6-4a6f-a082-c86a6a690d87 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:14.957442 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d3d76d69-5fa6-4a6f-a082-c86a6a690d87 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:14.965885 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d3d76d69-5fa6-4a6f-a082-c86a6a690d87 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1317 microversion: 2.1 time: 0.421388 May 25 15:49:14.966466 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 570/1153] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:14 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:15.880487 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-8956c745-8791-4b6f-acef-8069f36c6e89 req-bf11a2d0-30fa-4b54-8087-f197b436e4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c381c82c-5123-4915-b9b2-8f65b8ffaf9b", "name": "network-vif-plugged", "status": "completed", "tag": "6fd10c0b-7953-4682-8b93-6b38d31fbca5"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:15.882648 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:49:15.882648 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:49:15.892760 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-8956c745-8791-4b6f-acef-8069f36c6e89 req-bf11a2d0-30fa-4b54-8087-f197b436e4a3 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:15.893217 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-8956c745-8791-4b6f-acef-8069f36c6e89 req-bf11a2d0-30fa-4b54-8087-f197b436e4a3 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:15.909653 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-8956c745-8791-4b6f-acef-8069f36c6e89 req-bf11a2d0-30fa-4b54-8087-f197b436e4a3 service nova] Creating event network-vif-plugged:6fd10c0b-7953-4682-8b93-6b38d31fbca5 for instance c381c82c-5123-4915-b9b2-8f65b8ffaf9b on hv-cinder-79123 May 25 15:49:15.914377 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-8956c745-8791-4b6f-acef-8069f36c6e89 req-bf11a2d0-30fa-4b54-8087-f197b436e4a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039996 May 25 15:49:15.915308 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 584/1154] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:49:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:49:15.983164 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2668726b-d9a8-497b-be28-99310d4e56bf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:15.983891 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2668726b-d9a8-497b-be28-99310d4e56bf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:15.993175 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2668726b-d9a8-497b-be28-99310d4e56bf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:15.993627 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2668726b-d9a8-497b-be28-99310d4e56bf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:15.994689 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2668726b-d9a8-497b-be28-99310d4e56bf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:15.995221 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2668726b-d9a8-497b-be28-99310d4e56bf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:16.453929 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2668726b-d9a8-497b-be28-99310d4e56bf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:16.463434 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2668726b-d9a8-497b-be28-99310d4e56bf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1317 microversion: 2.1 time: 0.483788 May 25 15:49:16.473310 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 571/1155] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:15 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:17.484838 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5f9f7434-3e50-408f-8370-6b70e53395bb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:17.486222 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5f9f7434-3e50-408f-8370-6b70e53395bb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:17.501282 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5f9f7434-3e50-408f-8370-6b70e53395bb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:17.502585 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5f9f7434-3e50-408f-8370-6b70e53395bb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:17.504740 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5f9f7434-3e50-408f-8370-6b70e53395bb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:17.505390 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5f9f7434-3e50-408f-8370-6b70e53395bb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:17.718504 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5f9f7434-3e50-408f-8370-6b70e53395bb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:17.727195 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5f9f7434-3e50-408f-8370-6b70e53395bb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1317 microversion: 2.1 time: 0.248856 May 25 15:49:17.727901 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 585/1156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:17 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:18.744193 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9b808614-ceb2-4ad4-a88d-9eecbbcd524a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:18.744821 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9b808614-ceb2-4ad4-a88d-9eecbbcd524a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:18.752149 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9b808614-ceb2-4ad4-a88d-9eecbbcd524a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:18.752606 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9b808614-ceb2-4ad4-a88d-9eecbbcd524a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:18.753522 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9b808614-ceb2-4ad4-a88d-9eecbbcd524a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:18.753966 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9b808614-ceb2-4ad4-a88d-9eecbbcd524a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:19.049372 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9b808614-ceb2-4ad4-a88d-9eecbbcd524a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:19.058092 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9b808614-ceb2-4ad4-a88d-9eecbbcd524a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1507 microversion: 2.1 time: 0.317847 May 25 15:49:19.058655 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 572/1157] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:18 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:19.074538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ced59ccc-3201-4897-ab22-09fba76dbfcd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40adee2b-0868-4781-a959-2c80e871e523"}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:19.075620 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ced59ccc-3201-4897-ab22-09fba76dbfcd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:19.083545 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ced59ccc-3201-4897-ab22-09fba76dbfcd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:19.084043 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ced59ccc-3201-4897-ab22-09fba76dbfcd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:19.084842 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ced59ccc-3201-4897-ab22-09fba76dbfcd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:19.085291 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ced59ccc-3201-4897-ab22-09fba76dbfcd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:19.257493 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-ced59ccc-3201-4897-ab22-09fba76dbfcd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] HTTP exception thrown: Invalid volume: volume 40adee2b-0868-4781-a959-2c80e871e523 is already attached to instances: fef24ea0-a934-410a-8440-614ba104efd6 May 25 15:49:19.257653 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ced59ccc-3201-4897-ab22-09fba76dbfcd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Returning 400 to user: Invalid volume: volume 40adee2b-0868-4781-a959-2c80e871e523 is already attached to instances: fef24ea0-a934-410a-8440-614ba104efd6 {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:49:19.258482 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ced59ccc-3201-4897-ab22-09fba76dbfcd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "POST /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.187850 May 25 15:49:19.259042 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 586/1158] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:49:19 2021] POST /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b/os-volume_attachments => generated 174 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 15:49:19.370860 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ef923fbd-1b19-4a67-bae1-745d597a59d5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:19.371360 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ef923fbd-1b19-4a67-bae1-745d597a59d5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:19.379435 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef923fbd-1b19-4a67-bae1-745d597a59d5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:19.379929 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef923fbd-1b19-4a67-bae1-745d597a59d5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:19.380711 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef923fbd-1b19-4a67-bae1-745d597a59d5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:19.381150 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ef923fbd-1b19-4a67-bae1-745d597a59d5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:19.572744 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-ef923fbd-1b19-4a67-bae1-745d597a59d5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lazy-loading 'services' on Instance uuid fef24ea0-a934-410a-8440-614ba104efd6 {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:49:19.722512 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ef923fbd-1b19-4a67-bae1-745d597a59d5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6/os-volume_attachments/40adee2b-0868-4781-a959-2c80e871e523" status: 202 len: 0 microversion: 2.1 time: 0.354514 May 25 15:49:19.723368 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 573/1159] 10.222.0.36 () {58 vars in 1416 bytes} [Tue May 25 15:49:19 2021] DELETE /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6/os-volume_attachments/40adee2b-0868-4781-a959-2c80e871e523 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:49:21.056900 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1088504663", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "networks": [{"uuid": "247feda9-7b6d-4c87-abaf-0b9c5d89f2d3"}]}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:21.120718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] validate_networks() for [('247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:49:21.643362 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:49:21.643804 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:49:21.644345 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:49:21.644773 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:49:21.645200 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:49:21.654462 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:21.654959 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:21.655767 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:21.656240 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:21.673750 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Getting quotas for project 6e1f97f6101d466a9c224075352387d8. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:49:21.677701 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Getting quotas for user be4361d882e741fe993a2856b105ae74 and project 6e1f97f6101d466a9c224075352387d8. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:49:21.687974 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:49:21.690307 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:49:21.734819 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681431 May 25 15:49:21.736052 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 587/1160] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:49:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:49:21.748020 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-faaeb25b-544e-4c45-9846-60577941374b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:21.748789 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-faaeb25b-544e-4c45-9846-60577941374b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:21.828953 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-faaeb25b-544e-4c45-9846-60577941374b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:21.836619 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-faaeb25b-544e-4c45-9846-60577941374b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1218 microversion: 2.1 time: 0.094663 May 25 15:49:21.837382 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 574/1161] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:21 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:22.854187 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-f1c8d888-646c-4e81-b45a-b5de70e55087 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:22.854940 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-f1c8d888-646c-4e81-b45a-b5de70e55087 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:22.863331 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f1c8d888-646c-4e81-b45a-b5de70e55087 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:22.863788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f1c8d888-646c-4e81-b45a-b5de70e55087 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:22.864619 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f1c8d888-646c-4e81-b45a-b5de70e55087 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:22.865068 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-f1c8d888-646c-4e81-b45a-b5de70e55087 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:23.020644 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-f1c8d888-646c-4e81-b45a-b5de70e55087 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:23.032810 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-f1c8d888-646c-4e81-b45a-b5de70e55087 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1278 microversion: 2.1 time: 0.182091 May 25 15:49:23.034112 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 588/1162] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:22 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:24.052450 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-40abd678-d747-482d-a5ad-5b5109a8f168 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:24.053128 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-40abd678-d747-482d-a5ad-5b5109a8f168 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:24.061756 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-40abd678-d747-482d-a5ad-5b5109a8f168 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:24.062203 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-40abd678-d747-482d-a5ad-5b5109a8f168 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:24.063186 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-40abd678-d747-482d-a5ad-5b5109a8f168 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:24.063621 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-40abd678-d747-482d-a5ad-5b5109a8f168 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:24.275416 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-40abd678-d747-482d-a5ad-5b5109a8f168 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:24.285260 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-40abd678-d747-482d-a5ad-5b5109a8f168 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1318 microversion: 2.1 time: 0.237449 May 25 15:49:24.285828 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 575/1163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:24 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:24.906241 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-382732c6-fa49-4d0e-ab7a-bdc1de36a546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0", "tag": "62e410a2-9c20-453a-864a-5ef7c5d2a2fd"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:24.909171 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:49:24.909171 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:49:24.918599 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-382732c6-fa49-4d0e-ab7a-bdc1de36a546 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:24.919205 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-382732c6-fa49-4d0e-ab7a-bdc1de36a546 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:24.944929 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-382732c6-fa49-4d0e-ab7a-bdc1de36a546 service nova] Creating event network-changed:62e410a2-9c20-453a-864a-5ef7c5d2a2fd for instance 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 on hv-cinder-79123 May 25 15:49:24.949749 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-382732c6-fa49-4d0e-ab7a-bdc1de36a546 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048102 May 25 15:49:24.950354 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 589/1164] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:49:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:49:25.302370 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-83e6512b-3d7b-4af3-a38e-0e74a74dcb23 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:25.303032 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-83e6512b-3d7b-4af3-a38e-0e74a74dcb23 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:25.311473 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-83e6512b-3d7b-4af3-a38e-0e74a74dcb23 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:25.311956 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-83e6512b-3d7b-4af3-a38e-0e74a74dcb23 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:25.312748 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-83e6512b-3d7b-4af3-a38e-0e74a74dcb23 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:25.313381 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-83e6512b-3d7b-4af3-a38e-0e74a74dcb23 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:25.539540 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-83e6512b-3d7b-4af3-a38e-0e74a74dcb23 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:25.553142 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-83e6512b-3d7b-4af3-a38e-0e74a74dcb23 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1318 microversion: 2.1 time: 0.253996 May 25 15:49:25.554306 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 576/1165] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:25 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:26.571242 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1b7d6667-dc38-492c-b6f7-0bd756314a89 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:26.572023 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1b7d6667-dc38-492c-b6f7-0bd756314a89 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:26.579893 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1b7d6667-dc38-492c-b6f7-0bd756314a89 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:26.580348 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1b7d6667-dc38-492c-b6f7-0bd756314a89 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:26.581133 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1b7d6667-dc38-492c-b6f7-0bd756314a89 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:26.581576 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1b7d6667-dc38-492c-b6f7-0bd756314a89 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:26.820631 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-1b7d6667-dc38-492c-b6f7-0bd756314a89 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:26.832387 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1b7d6667-dc38-492c-b6f7-0bd756314a89 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1318 microversion: 2.1 time: 0.265480 May 25 15:49:26.833359 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 590/1166] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:26 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:27.849944 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c5ae2c3c-64cb-4ae6-8fa3-ce570d59cac0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:27.850577 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c5ae2c3c-64cb-4ae6-8fa3-ce570d59cac0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:27.858722 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c5ae2c3c-64cb-4ae6-8fa3-ce570d59cac0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:27.859186 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c5ae2c3c-64cb-4ae6-8fa3-ce570d59cac0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:27.860024 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c5ae2c3c-64cb-4ae6-8fa3-ce570d59cac0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:27.860478 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c5ae2c3c-64cb-4ae6-8fa3-ce570d59cac0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:28.156814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c5ae2c3c-64cb-4ae6-8fa3-ce570d59cac0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:28.164883 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c5ae2c3c-64cb-4ae6-8fa3-ce570d59cac0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1318 microversion: 2.1 time: 0.318680 May 25 15:49:28.165441 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 577/1167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:27 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:29.181944 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-7534271b-94e5-4cb7-998a-603180dd9928 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:29.182560 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-7534271b-94e5-4cb7-998a-603180dd9928 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:29.190359 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7534271b-94e5-4cb7-998a-603180dd9928 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:29.190811 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7534271b-94e5-4cb7-998a-603180dd9928 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:29.191574 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7534271b-94e5-4cb7-998a-603180dd9928 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:29.192036 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-7534271b-94e5-4cb7-998a-603180dd9928 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:29.386970 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-7534271b-94e5-4cb7-998a-603180dd9928 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:29.395439 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-7534271b-94e5-4cb7-998a-603180dd9928 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1318 microversion: 2.1 time: 0.217165 May 25 15:49:29.396038 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 591/1168] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:29 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:30.412248 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-1d19d009-a0cb-446a-b46d-0743b497e7b3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:30.413054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-1d19d009-a0cb-446a-b46d-0743b497e7b3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:30.420213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1d19d009-a0cb-446a-b46d-0743b497e7b3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:30.420678 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1d19d009-a0cb-446a-b46d-0743b497e7b3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:30.421465 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1d19d009-a0cb-446a-b46d-0743b497e7b3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:30.421905 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-1d19d009-a0cb-446a-b46d-0743b497e7b3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:30.615739 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-1d19d009-a0cb-446a-b46d-0743b497e7b3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:30.623899 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-1d19d009-a0cb-446a-b46d-0743b497e7b3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1318 microversion: 2.1 time: 0.215488 May 25 15:49:30.624988 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 578/1169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:30 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:31.641934 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-dd6fa40e-980b-44e9-8f23-58e3b9724c90 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:31.642468 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-dd6fa40e-980b-44e9-8f23-58e3b9724c90 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:31.649771 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dd6fa40e-980b-44e9-8f23-58e3b9724c90 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:31.650224 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dd6fa40e-980b-44e9-8f23-58e3b9724c90 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:31.650996 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dd6fa40e-980b-44e9-8f23-58e3b9724c90 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:31.651438 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-dd6fa40e-980b-44e9-8f23-58e3b9724c90 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:31.852084 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-dd6fa40e-980b-44e9-8f23-58e3b9724c90 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:31.860275 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-dd6fa40e-980b-44e9-8f23-58e3b9724c90 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1318 microversion: 2.1 time: 0.222858 May 25 15:49:31.860849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 592/1170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:31 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:32.877333 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f20fa986-8ebc-4bb2-82b6-c9581deac933 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:32.877960 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f20fa986-8ebc-4bb2-82b6-c9581deac933 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:32.885510 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f20fa986-8ebc-4bb2-82b6-c9581deac933 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:32.885969 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f20fa986-8ebc-4bb2-82b6-c9581deac933 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:32.886789 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f20fa986-8ebc-4bb2-82b6-c9581deac933 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:32.887411 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f20fa986-8ebc-4bb2-82b6-c9581deac933 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:33.002477 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-8d812d3f-6ac5-4520-80a7-7994d1370e1a req-f65d91a0-09e6-4a84-872d-9a1cabaf993d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0", "name": "network-vif-plugged", "status": "completed", "tag": "62e410a2-9c20-453a-864a-5ef7c5d2a2fd"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:33.004753 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:49:33.004753 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:49:33.016310 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-8d812d3f-6ac5-4520-80a7-7994d1370e1a req-f65d91a0-09e6-4a84-872d-9a1cabaf993d service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:33.017288 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-8d812d3f-6ac5-4520-80a7-7994d1370e1a req-f65d91a0-09e6-4a84-872d-9a1cabaf993d service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:33.037480 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-8d812d3f-6ac5-4520-80a7-7994d1370e1a req-f65d91a0-09e6-4a84-872d-9a1cabaf993d service nova] Creating event network-vif-plugged:62e410a2-9c20-453a-864a-5ef7c5d2a2fd for instance 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 on hv-cinder-79123 May 25 15:49:33.043155 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-8d812d3f-6ac5-4520-80a7-7994d1370e1a req-f65d91a0-09e6-4a84-872d-9a1cabaf993d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045765 May 25 15:49:33.044822 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 593/1171] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:49:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:49:33.106714 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f20fa986-8ebc-4bb2-82b6-c9581deac933 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:33.116608 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f20fa986-8ebc-4bb2-82b6-c9581deac933 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1318 microversion: 2.1 time: 0.243169 May 25 15:49:33.119897 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 579/1172] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:32 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:34.133862 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fb7b4be0-03ec-4baf-a946-ace5d467d00d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:34.134500 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fb7b4be0-03ec-4baf-a946-ace5d467d00d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:34.142325 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fb7b4be0-03ec-4baf-a946-ace5d467d00d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:34.142785 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fb7b4be0-03ec-4baf-a946-ace5d467d00d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:34.143562 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fb7b4be0-03ec-4baf-a946-ace5d467d00d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:34.144040 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fb7b4be0-03ec-4baf-a946-ace5d467d00d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:34.343572 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-fb7b4be0-03ec-4baf-a946-ace5d467d00d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:34.351960 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fb7b4be0-03ec-4baf-a946-ace5d467d00d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1318 microversion: 2.1 time: 0.222321 May 25 15:49:34.352542 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 594/1173] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:34 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:35.369257 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bc5e3e63-4bfd-45d6-83e2-48131a88dc9d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:35.369900 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bc5e3e63-4bfd-45d6-83e2-48131a88dc9d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:35.377971 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bc5e3e63-4bfd-45d6-83e2-48131a88dc9d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:35.378432 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bc5e3e63-4bfd-45d6-83e2-48131a88dc9d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:35.379219 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bc5e3e63-4bfd-45d6-83e2-48131a88dc9d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:35.379664 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bc5e3e63-4bfd-45d6-83e2-48131a88dc9d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:35.593229 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-bc5e3e63-4bfd-45d6-83e2-48131a88dc9d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:35.601953 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bc5e3e63-4bfd-45d6-83e2-48131a88dc9d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1508 microversion: 2.1 time: 0.236251 May 25 15:49:35.602797 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 580/1174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:35 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:36.282853 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2113581996", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-980388926", "security_groups": [{"name": "tempest-secgroup-smoke-1147553235"}], "block_device_mapping_v2": [{"uuid": "3a1e39c9-b3a5-4a71-b747-95c27ee043fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d8a04926-b628-40fa-a53b-51df7783813d"}]}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:36.450384 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] validate_networks() for [('d8a04926-b628-40fa-a53b-51df7783813d', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:49:37.119006 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-13e85ae4-5e1f-4c4e-aed7-538a96c0d10a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d079fbe-9949-408f-91d4-1aaae59aef12"}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:37.120226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-13e85ae4-5e1f-4c4e-aed7-538a96c0d10a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:37.128323 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-13e85ae4-5e1f-4c4e-aed7-538a96c0d10a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:37.128778 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-13e85ae4-5e1f-4c4e-aed7-538a96c0d10a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:37.129549 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-13e85ae4-5e1f-4c4e-aed7-538a96c0d10a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:37.129986 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-13e85ae4-5e1f-4c4e-aed7-538a96c0d10a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:37.161653 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:49:37.162596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:49:37.163403 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:49:37.164068 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:49:37.164508 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:49:37.174256 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:37.175015 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:37.175809 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:37.176488 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:37.194927 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Getting quotas for project 8dff1003ceba47f6a75b4c3901343b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:49:37.199179 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Getting quotas for user 082a0ad3211940cda30d219bb251e2fe and project 8dff1003ceba47f6a75b4c3901343b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:49:37.308200 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:49:37.310433 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3a1e39c9-b3a5-4a71-b747-95c27ee043fc',volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:49:37.502238 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9f63ddab-c544-4b32-80ba-7477543865d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.223645 May 25 15:49:37.502896 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 595/1175] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:49:36 2021] POST /compute/v2.1/servers => generated 406 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 15:49:37.519425 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d60c4128-7362-41d6-b1db-672499cafa11 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:37.520597 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d60c4128-7362-41d6-b1db-672499cafa11 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:37.542358 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-13e85ae4-5e1f-4c4e-aed7-538a96c0d10a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "POST /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426710 May 25 15:49:37.543304 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 581/1176] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:49:37 2021] POST /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:49:37.622792 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d60c4128-7362-41d6-b1db-672499cafa11 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:37.634690 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d60c4128-7362-41d6-b1db-672499cafa11 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1094 microversion: 2.1 time: 0.125414 May 25 15:49:37.637344 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 596/1177] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:37 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1094 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:38.656699 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9e13e90d-9c10-4867-b7a8-d5794ea3cb66 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:38.657917 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9e13e90d-9c10-4867-b7a8-d5794ea3cb66 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:38.666517 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9e13e90d-9c10-4867-b7a8-d5794ea3cb66 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:38.667986 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9e13e90d-9c10-4867-b7a8-d5794ea3cb66 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:38.668952 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9e13e90d-9c10-4867-b7a8-d5794ea3cb66 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:38.669601 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9e13e90d-9c10-4867-b7a8-d5794ea3cb66 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:38.816292 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-9e13e90d-9c10-4867-b7a8-d5794ea3cb66 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:38.825900 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9e13e90d-9c10-4867-b7a8-d5794ea3cb66 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1192 microversion: 2.1 time: 0.176474 May 25 15:49:38.826641 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 582/1178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:38 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1192 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:39.842546 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a821d79f-4c00-4c1b-ac22-7f07f79925de tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:39.844025 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a821d79f-4c00-4c1b-ac22-7f07f79925de tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:39.857845 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a821d79f-4c00-4c1b-ac22-7f07f79925de tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:39.858312 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a821d79f-4c00-4c1b-ac22-7f07f79925de tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:39.860680 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a821d79f-4c00-4c1b-ac22-7f07f79925de tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:39.862493 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a821d79f-4c00-4c1b-ac22-7f07f79925de tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:40.500609 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a821d79f-4c00-4c1b-ac22-7f07f79925de tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:40.509242 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a821d79f-4c00-4c1b-ac22-7f07f79925de tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1278 microversion: 2.1 time: 0.670417 May 25 15:49:40.509741 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 597/1179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:39 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1278 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:41.105015 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-12979547-4714-4983-93eb-5ebcf76bab86 req-d7599dca-50da-429d-a7af-a20584400ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "727f4c83-6a75-4ccf-9f52-c2a83ecca801", "tag": "b62764e4-ba3e-4187-9554-db7555c582f2"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:41.109594 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:49:41.109594 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:49:41.132063 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-12979547-4714-4983-93eb-5ebcf76bab86 req-d7599dca-50da-429d-a7af-a20584400ae6 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:41.132690 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-12979547-4714-4983-93eb-5ebcf76bab86 req-d7599dca-50da-429d-a7af-a20584400ae6 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:41.153313 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-12979547-4714-4983-93eb-5ebcf76bab86 req-d7599dca-50da-429d-a7af-a20584400ae6 service nova] Creating event network-changed:b62764e4-ba3e-4187-9554-db7555c582f2 for instance 727f4c83-6a75-4ccf-9f52-c2a83ecca801 on hv-cinder-79123 May 25 15:49:41.160019 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-12979547-4714-4983-93eb-5ebcf76bab86 req-d7599dca-50da-429d-a7af-a20584400ae6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062232 May 25 15:49:41.161388 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 583/1180] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:49:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:49:41.526842 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-af2c1957-c902-4fe8-bc8f-695d9e9b2614 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:41.528166 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-af2c1957-c902-4fe8-bc8f-695d9e9b2614 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:41.537092 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-af2c1957-c902-4fe8-bc8f-695d9e9b2614 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:41.537474 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-af2c1957-c902-4fe8-bc8f-695d9e9b2614 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:41.538274 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-af2c1957-c902-4fe8-bc8f-695d9e9b2614 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:41.538721 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-af2c1957-c902-4fe8-bc8f-695d9e9b2614 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:41.873122 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-af2c1957-c902-4fe8-bc8f-695d9e9b2614 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:41.882556 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-af2c1957-c902-4fe8-bc8f-695d9e9b2614 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1278 microversion: 2.1 time: 0.359531 May 25 15:49:41.883246 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 598/1181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:41 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1278 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:42.900812 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6f99a666-e8ee-4132-b34d-69875943e6fd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:42.901801 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6f99a666-e8ee-4132-b34d-69875943e6fd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:42.909296 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6f99a666-e8ee-4132-b34d-69875943e6fd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:42.909752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6f99a666-e8ee-4132-b34d-69875943e6fd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:42.910519 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6f99a666-e8ee-4132-b34d-69875943e6fd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:42.911236 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6f99a666-e8ee-4132-b34d-69875943e6fd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:43.114358 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6f99a666-e8ee-4132-b34d-69875943e6fd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:43.123147 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6f99a666-e8ee-4132-b34d-69875943e6fd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1278 microversion: 2.1 time: 0.226473 May 25 15:49:43.123719 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 584/1182] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:42 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:44.140315 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-aae4af5f-2c11-46ae-8654-b88ed3eac695 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:44.141176 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-aae4af5f-2c11-46ae-8654-b88ed3eac695 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:44.148778 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-aae4af5f-2c11-46ae-8654-b88ed3eac695 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:44.149229 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-aae4af5f-2c11-46ae-8654-b88ed3eac695 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:44.149995 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-aae4af5f-2c11-46ae-8654-b88ed3eac695 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:44.150459 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-aae4af5f-2c11-46ae-8654-b88ed3eac695 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:44.357463 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-aae4af5f-2c11-46ae-8654-b88ed3eac695 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:44.373704 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-aae4af5f-2c11-46ae-8654-b88ed3eac695 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1278 microversion: 2.1 time: 0.237014 May 25 15:49:44.375050 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 599/1183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:44 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1278 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:45.391360 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-4b3ce5d7-ee03-4c0c-8a34-470fe9ef7fc0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:45.392140 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-4b3ce5d7-ee03-4c0c-8a34-470fe9ef7fc0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:45.400998 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4b3ce5d7-ee03-4c0c-8a34-470fe9ef7fc0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:45.401558 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4b3ce5d7-ee03-4c0c-8a34-470fe9ef7fc0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:45.402495 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4b3ce5d7-ee03-4c0c-8a34-470fe9ef7fc0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:45.404286 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-4b3ce5d7-ee03-4c0c-8a34-470fe9ef7fc0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:45.473416 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3ec04416-9e25-4a79-98d0-6f93ef5690fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d079fbe-9949-408f-91d4-1aaae59aef12"}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:45.474643 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-3ec04416-9e25-4a79-98d0-6f93ef5690fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:45.483231 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3ec04416-9e25-4a79-98d0-6f93ef5690fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:45.484308 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3ec04416-9e25-4a79-98d0-6f93ef5690fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:45.485105 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3ec04416-9e25-4a79-98d0-6f93ef5690fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:45.485556 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-3ec04416-9e25-4a79-98d0-6f93ef5690fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:45.604896 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-4b3ce5d7-ee03-4c0c-8a34-470fe9ef7fc0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:45.616102 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-4b3ce5d7-ee03-4c0c-8a34-470fe9ef7fc0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1278 microversion: 2.1 time: 0.228662 May 25 15:49:45.616687 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 585/1184] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:45 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:45.653075 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-3ec04416-9e25-4a79-98d0-6f93ef5690fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] HTTP exception thrown: Invalid volume: volume 8d079fbe-9949-408f-91d4-1aaae59aef12 is already attached to instances: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 May 25 15:49:45.653718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-3ec04416-9e25-4a79-98d0-6f93ef5690fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Returning 400 to user: Invalid volume: volume 8d079fbe-9949-408f-91d4-1aaae59aef12 is already attached to instances: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:49:45.654587 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-3ec04416-9e25-4a79-98d0-6f93ef5690fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "POST /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.185512 May 25 15:49:45.655146 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 600/1185] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:49:45 2021] POST /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0/os-volume_attachments => generated 174 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 25 15:49:45.760020 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0ec28188-05d2-4838-89ae-829bab6012a9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:45.760533 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0ec28188-05d2-4838-89ae-829bab6012a9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:45.768684 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0ec28188-05d2-4838-89ae-829bab6012a9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:45.769143 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0ec28188-05d2-4838-89ae-829bab6012a9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:45.769927 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0ec28188-05d2-4838-89ae-829bab6012a9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:45.770374 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0ec28188-05d2-4838-89ae-829bab6012a9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:45.954235 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-0ec28188-05d2-4838-89ae-829bab6012a9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lazy-loading 'services' on Instance uuid 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:49:46.100001 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0ec28188-05d2-4838-89ae-829bab6012a9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0/os-volume_attachments/8d079fbe-9949-408f-91d4-1aaae59aef12" status: 202 len: 0 microversion: 2.1 time: 0.338634 May 25 15:49:46.100001 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 586/1186] 10.222.0.36 () {58 vars in 1416 bytes} [Tue May 25 15:49:45 2021] DELETE /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0/os-volume_attachments/8d079fbe-9949-408f-91d4-1aaae59aef12 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:49:46.632503 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-09048c42-f0c6-471c-a0db-bf5518806597 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:46.633130 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-09048c42-f0c6-471c-a0db-bf5518806597 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:46.641769 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-09048c42-f0c6-471c-a0db-bf5518806597 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:46.642225 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-09048c42-f0c6-471c-a0db-bf5518806597 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:46.643011 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-09048c42-f0c6-471c-a0db-bf5518806597 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:46.643431 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-09048c42-f0c6-471c-a0db-bf5518806597 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:46.844917 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-09048c42-f0c6-471c-a0db-bf5518806597 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:46.853106 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-09048c42-f0c6-471c-a0db-bf5518806597 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.224367 May 25 15:49:46.853669 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 601/1187] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:46 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:47.870682 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-696c0ef9-bf9e-4755-91dc-e8e1d0a52578 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:47.871318 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-696c0ef9-bf9e-4755-91dc-e8e1d0a52578 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:47.879035 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-696c0ef9-bf9e-4755-91dc-e8e1d0a52578 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:47.879494 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-696c0ef9-bf9e-4755-91dc-e8e1d0a52578 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:47.880310 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-696c0ef9-bf9e-4755-91dc-e8e1d0a52578 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:47.880758 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-696c0ef9-bf9e-4755-91dc-e8e1d0a52578 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:48.081374 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-696c0ef9-bf9e-4755-91dc-e8e1d0a52578 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:48.089848 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-696c0ef9-bf9e-4755-91dc-e8e1d0a52578 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.223400 May 25 15:49:48.090425 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 587/1188] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:47 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:48.504233 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1706353015", "imageRef": "c2b8f0bf-27d9-466f-90da-1e3d1335406e", "flavorRef": "452", "networks": [{"uuid": "247feda9-7b6d-4c87-abaf-0b9c5d89f2d3"}]}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:48.568181 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.network.neutron [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] validate_networks() for [('247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', None, None, None)] {{(pid=112577) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 25 15:49:49.090733 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Flavor limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 25 15:49:49.091209 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Image limits 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 25 15:49:49.091702 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Flavor pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 25 15:49:49.092194 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Image pref 0:0:0 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 25 15:49:49.092662 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.virt.hardware [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=112577) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 25 15:49:49.101226 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:49.101868 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:49.102699 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:49.103145 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:49.106447 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-486a7aca-9b45-44bb-9c79-e50e18420c56 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:49.107207 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-486a7aca-9b45-44bb-9c79-e50e18420c56 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:49.115223 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-486a7aca-9b45-44bb-9c79-e50e18420c56 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:49.115681 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-486a7aca-9b45-44bb-9c79-e50e18420c56 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:49.116490 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-486a7aca-9b45-44bb-9c79-e50e18420c56 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:49.117059 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-486a7aca-9b45-44bb-9c79-e50e18420c56 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:49.121519 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Getting quotas for project 6e1f97f6101d466a9c224075352387d8. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 25 15:49:49.126077 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.quota [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Getting quotas for user be4361d882e741fe993a2856b105ae74 and project 6e1f97f6101d466a9c224075352387d8. Resources: {'instances', 'ram', 'cores'} {{(pid=112577) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 25 15:49:49.136916 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Going to run 1 instances... {{(pid=112577) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 25 15:49:49.139280 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2b8f0bf-27d9-466f-90da-1e3d1335406e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=112577) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 25 15:49:49.193186 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692162 May 25 15:49:49.194691 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 602/1189] 10.222.0.36 () {60 vars in 1147 bytes} [Tue May 25 15:49:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:49:49.204828 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-9bc1e738-40e7-4f61-b0da-a6b0a623fe62 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:49.205449 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-9bc1e738-40e7-4f61-b0da-a6b0a623fe62 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:49.293247 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-9bc1e738-40e7-4f61-b0da-a6b0a623fe62 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:49.302245 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-9bc1e738-40e7-4f61-b0da-a6b0a623fe62 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1218 microversion: 2.1 time: 0.101230 May 25 15:49:49.311452 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 603/1190] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:49 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:49.523201 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-486a7aca-9b45-44bb-9c79-e50e18420c56 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:49.533308 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-486a7aca-9b45-44bb-9c79-e50e18420c56 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.430503 May 25 15:49:49.533889 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 588/1191] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:49 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:50.318866 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-be534aaf-d3e3-42fa-b897-5d2104108c77 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:50.319719 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-be534aaf-d3e3-42fa-b897-5d2104108c77 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:50.327321 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-be534aaf-d3e3-42fa-b897-5d2104108c77 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:50.327940 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-be534aaf-d3e3-42fa-b897-5d2104108c77 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:50.328827 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-be534aaf-d3e3-42fa-b897-5d2104108c77 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:50.329373 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-be534aaf-d3e3-42fa-b897-5d2104108c77 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:50.551227 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-216ea2f6-ac7d-46c4-85e5-32a56b0e11ca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:50.552544 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-216ea2f6-ac7d-46c4-85e5-32a56b0e11ca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:50.560821 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-216ea2f6-ac7d-46c4-85e5-32a56b0e11ca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:50.563499 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-216ea2f6-ac7d-46c4-85e5-32a56b0e11ca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:50.564742 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-216ea2f6-ac7d-46c4-85e5-32a56b0e11ca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:50.565867 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-216ea2f6-ac7d-46c4-85e5-32a56b0e11ca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:50.599680 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-be534aaf-d3e3-42fa-b897-5d2104108c77 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:50.610259 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-be534aaf-d3e3-42fa-b897-5d2104108c77 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1278 microversion: 2.1 time: 0.294986 May 25 15:49:50.611034 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 604/1192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:50 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1278 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:50.805712 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-216ea2f6-ac7d-46c4-85e5-32a56b0e11ca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:50.816056 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-216ea2f6-ac7d-46c4-85e5-32a56b0e11ca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.269509 May 25 15:49:50.816743 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 589/1193] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:50 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:51.627486 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a5aa01ac-b875-485c-a360-bc3ca058662f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:51.628859 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a5aa01ac-b875-485c-a360-bc3ca058662f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:51.636172 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a5aa01ac-b875-485c-a360-bc3ca058662f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:51.636621 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a5aa01ac-b875-485c-a360-bc3ca058662f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:51.637432 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a5aa01ac-b875-485c-a360-bc3ca058662f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:51.637923 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a5aa01ac-b875-485c-a360-bc3ca058662f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:51.832526 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-42b98669-d719-422a-bd34-94c708304dac tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:51.833410 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-42b98669-d719-422a-bd34-94c708304dac tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:51.840898 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-42b98669-d719-422a-bd34-94c708304dac tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:51.841289 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-42b98669-d719-422a-bd34-94c708304dac tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:51.842060 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-42b98669-d719-422a-bd34-94c708304dac tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:51.842497 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-42b98669-d719-422a-bd34-94c708304dac tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:52.048023 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-42b98669-d719-422a-bd34-94c708304dac tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:52.056662 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-42b98669-d719-422a-bd34-94c708304dac tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.227865 May 25 15:49:52.057053 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a5aa01ac-b875-485c-a360-bc3ca058662f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:52.066158 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a5aa01ac-b875-485c-a360-bc3ca058662f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1318 microversion: 2.1 time: 0.442792 May 25 15:49:52.067166 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 605/1195] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:51 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:52.067458 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 590/1195] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:51 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:52.521075 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-18660bb6-1b1e-4b18-8965-e9b06c7414ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2596d47a-e4cc-4252-9e3f-bf7559a4cbda", "tag": "1edf8be0-5889-4766-ae81-82de066f9110"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:52.522749 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:49:52.522749 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:49:52.532534 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-18660bb6-1b1e-4b18-8965-e9b06c7414ad service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:52.532983 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-18660bb6-1b1e-4b18-8965-e9b06c7414ad service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:52.550233 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-18660bb6-1b1e-4b18-8965-e9b06c7414ad service nova] Creating event network-changed:1edf8be0-5889-4766-ae81-82de066f9110 for instance 2596d47a-e4cc-4252-9e3f-bf7559a4cbda on hv-cinder-79123 May 25 15:49:52.554756 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-18660bb6-1b1e-4b18-8965-e9b06c7414ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037490 May 25 15:49:52.555349 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 591/1196] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:49:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:49:53.074368 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ca35e8dd-591a-4e7a-a17c-e044640b65eb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:53.074999 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ca35e8dd-591a-4e7a-a17c-e044640b65eb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:53.082938 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca35e8dd-591a-4e7a-a17c-e044640b65eb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:53.083404 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca35e8dd-591a-4e7a-a17c-e044640b65eb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:53.084234 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca35e8dd-591a-4e7a-a17c-e044640b65eb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:53.084690 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca35e8dd-591a-4e7a-a17c-e044640b65eb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:53.084789 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-baeb99b7-3e42-41f1-a695-00f5adb1f8de tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:53.085484 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-baeb99b7-3e42-41f1-a695-00f5adb1f8de tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:53.093299 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-baeb99b7-3e42-41f1-a695-00f5adb1f8de tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:53.093758 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-baeb99b7-3e42-41f1-a695-00f5adb1f8de tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:53.094549 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-baeb99b7-3e42-41f1-a695-00f5adb1f8de tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:53.094995 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-baeb99b7-3e42-41f1-a695-00f5adb1f8de tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:53.288593 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-baeb99b7-3e42-41f1-a695-00f5adb1f8de tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:53.297524 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-baeb99b7-3e42-41f1-a695-00f5adb1f8de tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1318 microversion: 2.1 time: 0.216883 May 25 15:49:53.298083 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 592/1197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:53 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:53.332867 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ca35e8dd-591a-4e7a-a17c-e044640b65eb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:53.341391 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ca35e8dd-591a-4e7a-a17c-e044640b65eb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.270864 May 25 15:49:53.342076 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 606/1198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:53 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:54.314071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7fab4e0f-785c-421d-9ed6-8dee7e060f60 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:54.314682 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7fab4e0f-785c-421d-9ed6-8dee7e060f60 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:54.322379 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7fab4e0f-785c-421d-9ed6-8dee7e060f60 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:54.322840 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7fab4e0f-785c-421d-9ed6-8dee7e060f60 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:54.323621 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7fab4e0f-785c-421d-9ed6-8dee7e060f60 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:54.324105 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7fab4e0f-785c-421d-9ed6-8dee7e060f60 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:54.357620 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a5b2458a-644c-45cd-aebc-74e2ff04ca62 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:54.358243 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a5b2458a-644c-45cd-aebc-74e2ff04ca62 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:54.365573 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a5b2458a-644c-45cd-aebc-74e2ff04ca62 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:54.366028 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a5b2458a-644c-45cd-aebc-74e2ff04ca62 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:54.366799 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a5b2458a-644c-45cd-aebc-74e2ff04ca62 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:54.367267 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a5b2458a-644c-45cd-aebc-74e2ff04ca62 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:54.526418 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-7fab4e0f-785c-421d-9ed6-8dee7e060f60 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:54.534669 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7fab4e0f-785c-421d-9ed6-8dee7e060f60 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1318 microversion: 2.1 time: 0.224363 May 25 15:49:54.535240 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 593/1199] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:54 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:54.563264 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a5b2458a-644c-45cd-aebc-74e2ff04ca62 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:54.571614 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a5b2458a-644c-45cd-aebc-74e2ff04ca62 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.217617 May 25 15:49:54.572158 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 607/1200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:54 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:55.551253 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f1bb6e8c-28eb-41e5-9b12-0039dfe4bc5f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:55.552065 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f1bb6e8c-28eb-41e5-9b12-0039dfe4bc5f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:55.559366 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f1bb6e8c-28eb-41e5-9b12-0039dfe4bc5f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:55.559839 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f1bb6e8c-28eb-41e5-9b12-0039dfe4bc5f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:55.560663 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f1bb6e8c-28eb-41e5-9b12-0039dfe4bc5f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:55.561114 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f1bb6e8c-28eb-41e5-9b12-0039dfe4bc5f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:55.588720 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-653d2afe-0e97-4cab-9573-4512a6b6c01f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:55.590065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-653d2afe-0e97-4cab-9573-4512a6b6c01f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:55.598699 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-653d2afe-0e97-4cab-9573-4512a6b6c01f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:55.599556 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-653d2afe-0e97-4cab-9573-4512a6b6c01f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:55.600647 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-653d2afe-0e97-4cab-9573-4512a6b6c01f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:55.601374 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-653d2afe-0e97-4cab-9573-4512a6b6c01f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:55.810892 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-f1bb6e8c-28eb-41e5-9b12-0039dfe4bc5f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:55.824669 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f1bb6e8c-28eb-41e5-9b12-0039dfe4bc5f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1318 microversion: 2.1 time: 0.276991 May 25 15:49:55.825832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 594/1201] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:55 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:55.864446 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-653d2afe-0e97-4cab-9573-4512a6b6c01f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:55.874160 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-653d2afe-0e97-4cab-9573-4512a6b6c01f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.288953 May 25 15:49:55.879916 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 608/1202] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:55 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:56.842081 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c3d25f0b-c83f-4c39-952d-fe01e2c45542 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:56.842705 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c3d25f0b-c83f-4c39-952d-fe01e2c45542 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:56.850586 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c3d25f0b-c83f-4c39-952d-fe01e2c45542 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:56.851044 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c3d25f0b-c83f-4c39-952d-fe01e2c45542 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:56.851816 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c3d25f0b-c83f-4c39-952d-fe01e2c45542 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:56.852283 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c3d25f0b-c83f-4c39-952d-fe01e2c45542 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:56.891587 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-40f0ad1a-7ecf-4b71-8e9c-7faa78edc023 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:56.892237 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-40f0ad1a-7ecf-4b71-8e9c-7faa78edc023 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:56.907402 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-40f0ad1a-7ecf-4b71-8e9c-7faa78edc023 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:56.907848 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-40f0ad1a-7ecf-4b71-8e9c-7faa78edc023 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:56.908665 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-40f0ad1a-7ecf-4b71-8e9c-7faa78edc023 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:56.909301 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-40f0ad1a-7ecf-4b71-8e9c-7faa78edc023 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:57.055283 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c3d25f0b-c83f-4c39-952d-fe01e2c45542 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:57.065489 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c3d25f0b-c83f-4c39-952d-fe01e2c45542 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1318 microversion: 2.1 time: 0.227045 May 25 15:49:57.066303 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 595/1203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:56 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:57.116896 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-40f0ad1a-7ecf-4b71-8e9c-7faa78edc023 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:57.125267 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-40f0ad1a-7ecf-4b71-8e9c-7faa78edc023 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.237592 May 25 15:49:57.125845 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 609/1204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:56 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:58.082384 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b5629cce-890e-4129-8800-d930bc9db007 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:58.083023 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b5629cce-890e-4129-8800-d930bc9db007 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:58.090317 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b5629cce-890e-4129-8800-d930bc9db007 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:58.090781 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b5629cce-890e-4129-8800-d930bc9db007 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:58.091567 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b5629cce-890e-4129-8800-d930bc9db007 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:58.092047 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b5629cce-890e-4129-8800-d930bc9db007 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:58.141731 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ff1c58a6-9b71-477c-a952-effae252d57b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:58.142396 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ff1c58a6-9b71-477c-a952-effae252d57b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:58.149743 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ff1c58a6-9b71-477c-a952-effae252d57b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:58.150206 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ff1c58a6-9b71-477c-a952-effae252d57b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:58.150987 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ff1c58a6-9b71-477c-a952-effae252d57b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:58.151420 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ff1c58a6-9b71-477c-a952-effae252d57b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:58.306938 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b5629cce-890e-4129-8800-d930bc9db007 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:58.315406 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b5629cce-890e-4129-8800-d930bc9db007 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1318 microversion: 2.1 time: 0.236837 May 25 15:49:58.316159 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 596/1205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:58 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:58.660139 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ff1c58a6-9b71-477c-a952-effae252d57b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:58.668579 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ff1c58a6-9b71-477c-a952-effae252d57b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.531231 May 25 15:49:58.669152 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 610/1206] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:58 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:49:59.107032 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-ef56aea9-ff43-4267-879e-89e8672005dd req-05d816be-2b35-41b6-85f3-80afcb259989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2596d47a-e4cc-4252-9e3f-bf7559a4cbda", "name": "network-vif-plugged", "status": "completed", "tag": "1edf8be0-5889-4766-ae81-82de066f9110"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:49:59.109233 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:49:59.109233 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:49:59.118019 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-ef56aea9-ff43-4267-879e-89e8672005dd req-05d816be-2b35-41b6-85f3-80afcb259989 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:59.118465 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-ef56aea9-ff43-4267-879e-89e8672005dd req-05d816be-2b35-41b6-85f3-80afcb259989 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:59.135054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-ef56aea9-ff43-4267-879e-89e8672005dd req-05d816be-2b35-41b6-85f3-80afcb259989 service nova] Creating event network-vif-plugged:1edf8be0-5889-4766-ae81-82de066f9110 for instance 2596d47a-e4cc-4252-9e3f-bf7559a4cbda on hv-cinder-79123 May 25 15:49:59.139974 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-ef56aea9-ff43-4267-879e-89e8672005dd req-05d816be-2b35-41b6-85f3-80afcb259989 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038856 May 25 15:49:59.141794 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 597/1207] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:49:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:49:59.333592 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8aab7187-e994-4a37-884c-93caa9528058 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:59.335826 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8aab7187-e994-4a37-884c-93caa9528058 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:59.344049 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8aab7187-e994-4a37-884c-93caa9528058 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:59.345200 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8aab7187-e994-4a37-884c-93caa9528058 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:59.346269 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8aab7187-e994-4a37-884c-93caa9528058 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:59.346942 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8aab7187-e994-4a37-884c-93caa9528058 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:59.591709 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-8aab7187-e994-4a37-884c-93caa9528058 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:59.599915 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8aab7187-e994-4a37-884c-93caa9528058 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1318 microversion: 2.1 time: 0.271133 May 25 15:49:59.600494 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 611/1208] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:59 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:49:59.685693 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-51d84d66-bd24-41c0-81f6-9d63a43d1dc1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:49:59.686348 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-51d84d66-bd24-41c0-81f6-9d63a43d1dc1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:49:59.693902 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-51d84d66-bd24-41c0-81f6-9d63a43d1dc1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:59.694437 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-51d84d66-bd24-41c0-81f6-9d63a43d1dc1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:59.695309 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-51d84d66-bd24-41c0-81f6-9d63a43d1dc1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:59.695747 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-51d84d66-bd24-41c0-81f6-9d63a43d1dc1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:59.906869 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-51d84d66-bd24-41c0-81f6-9d63a43d1dc1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:49:59.915159 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-51d84d66-bd24-41c0-81f6-9d63a43d1dc1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.233678 May 25 15:49:59.915728 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 598/1209] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:49:59 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:00.616167 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-66ee3888-44ea-4993-ac02-c6db654ed235 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:00.616788 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-66ee3888-44ea-4993-ac02-c6db654ed235 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:00.624849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-66ee3888-44ea-4993-ac02-c6db654ed235 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:00.625303 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-66ee3888-44ea-4993-ac02-c6db654ed235 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:00.626087 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-66ee3888-44ea-4993-ac02-c6db654ed235 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:00.626527 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-66ee3888-44ea-4993-ac02-c6db654ed235 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:00.846620 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-66ee3888-44ea-4993-ac02-c6db654ed235 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:00.855136 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-66ee3888-44ea-4993-ac02-c6db654ed235 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1318 microversion: 2.1 time: 0.242701 May 25 15:50:00.855715 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 612/1210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:00 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:00.932054 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-2f071866-73d9-4fdb-8e44-d342cdf2c923 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:00.932771 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-2f071866-73d9-4fdb-8e44-d342cdf2c923 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:00.940773 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f071866-73d9-4fdb-8e44-d342cdf2c923 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:00.941319 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f071866-73d9-4fdb-8e44-d342cdf2c923 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:00.942202 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f071866-73d9-4fdb-8e44-d342cdf2c923 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:00.942725 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-2f071866-73d9-4fdb-8e44-d342cdf2c923 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:01.138507 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-2f071866-73d9-4fdb-8e44-d342cdf2c923 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:01.146941 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-2f071866-73d9-4fdb-8e44-d342cdf2c923 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.218534 May 25 15:50:01.147523 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 599/1211] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:00 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:01.191109 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-1e41c3c0-7226-49c1-be89-600487146c6b req-df5fbdf4-24b4-4f05-9bc4-9660d91f5513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "727f4c83-6a75-4ccf-9f52-c2a83ecca801", "name": "network-vif-plugged", "status": "completed", "tag": "b62764e4-ba3e-4187-9554-db7555c582f2"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:50:01.192866 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:50:01.192866 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:50:01.201088 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-1e41c3c0-7226-49c1-be89-600487146c6b req-df5fbdf4-24b4-4f05-9bc4-9660d91f5513 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:01.201621 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-1e41c3c0-7226-49c1-be89-600487146c6b req-df5fbdf4-24b4-4f05-9bc4-9660d91f5513 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:01.217868 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-1e41c3c0-7226-49c1-be89-600487146c6b req-df5fbdf4-24b4-4f05-9bc4-9660d91f5513 service nova] Creating event network-vif-plugged:b62764e4-ba3e-4187-9554-db7555c582f2 for instance 727f4c83-6a75-4ccf-9f52-c2a83ecca801 on hv-cinder-79123 May 25 15:50:01.223741 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-1e41c3c0-7226-49c1-be89-600487146c6b req-df5fbdf4-24b4-4f05-9bc4-9660d91f5513 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036434 May 25 15:50:01.224381 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 613/1212] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:50:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:50:01.872430 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-446179fe-3c38-4083-98e5-0334cd238d95 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:01.873066 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-446179fe-3c38-4083-98e5-0334cd238d95 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:01.880738 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-446179fe-3c38-4083-98e5-0334cd238d95 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:01.881229 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-446179fe-3c38-4083-98e5-0334cd238d95 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:01.882047 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-446179fe-3c38-4083-98e5-0334cd238d95 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:01.882492 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-446179fe-3c38-4083-98e5-0334cd238d95 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:02.085434 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-446179fe-3c38-4083-98e5-0334cd238d95 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:02.097026 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-446179fe-3c38-4083-98e5-0334cd238d95 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1509 microversion: 2.1 time: 0.228276 May 25 15:50:02.097607 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 600/1213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:01 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:02.164596 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a3403e1b-aec7-4c69-9bbd-bff0659ac1d1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:02.165928 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a3403e1b-aec7-4c69-9bbd-bff0659ac1d1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:02.173742 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a3403e1b-aec7-4c69-9bbd-bff0659ac1d1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:02.174201 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a3403e1b-aec7-4c69-9bbd-bff0659ac1d1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:02.174992 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a3403e1b-aec7-4c69-9bbd-bff0659ac1d1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:02.175437 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a3403e1b-aec7-4c69-9bbd-bff0659ac1d1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:02.386575 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-a3403e1b-aec7-4c69-9bbd-bff0659ac1d1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:02.396875 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a3403e1b-aec7-4c69-9bbd-bff0659ac1d1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1266 microversion: 2.1 time: 0.236287 May 25 15:50:02.398092 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 614/1214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:02 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:03.414854 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3cf65a79-8b9b-4edb-a388-818853bc379a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:03.415504 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-3cf65a79-8b9b-4edb-a388-818853bc379a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:03.422986 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3cf65a79-8b9b-4edb-a388-818853bc379a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:03.423442 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3cf65a79-8b9b-4edb-a388-818853bc379a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:03.424244 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3cf65a79-8b9b-4edb-a388-818853bc379a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:03.424686 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-3cf65a79-8b9b-4edb-a388-818853bc379a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:03.620577 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-3cf65a79-8b9b-4edb-a388-818853bc379a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:03.621818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-1815ea83-ab03-423d-a55d-c0885f551c6b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21bc77d6-cb38-436e-a9d2-b68c7800151b"}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:50:03.622874 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-1815ea83-ab03-423d-a55d-c0885f551c6b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:03.629560 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3cf65a79-8b9b-4edb-a388-818853bc379a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1452 microversion: 2.1 time: 0.218415 May 25 15:50:03.630517 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1815ea83-ab03-423d-a55d-c0885f551c6b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:03.631144 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1815ea83-ab03-423d-a55d-c0885f551c6b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:03.632427 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1815ea83-ab03-423d-a55d-c0885f551c6b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:03.634318 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-1815ea83-ab03-423d-a55d-c0885f551c6b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:03.635814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 601/1215] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:03 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1452 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:03.647075 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-be485876-19a4-4d8d-baa8-5a4f6fa16efb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:03.647711 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-be485876-19a4-4d8d-baa8-5a4f6fa16efb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:03.655038 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-be485876-19a4-4d8d-baa8-5a4f6fa16efb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:03.655536 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-be485876-19a4-4d8d-baa8-5a4f6fa16efb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:03.656357 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-be485876-19a4-4d8d-baa8-5a4f6fa16efb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:03.656805 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-be485876-19a4-4d8d-baa8-5a4f6fa16efb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:03.864997 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-be485876-19a4-4d8d-baa8-5a4f6fa16efb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:03.876125 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-be485876-19a4-4d8d-baa8-5a4f6fa16efb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1452 microversion: 2.1 time: 0.232641 May 25 15:50:03.876641 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 602/1216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:03 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1452 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:50:04.035298 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-1815ea83-ab03-423d-a55d-c0885f551c6b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "POST /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417053 May 25 15:50:04.036246 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 615/1217] 10.222.0.36 () {60 vars in 1323 bytes} [Tue May 25 15:50:03 2021] POST /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:50:06.573370 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-1fcaa249-d458-4b31-87c0-ceac553afec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "727f4c83-6a75-4ccf-9f52-c2a83ecca801", "tag": "b62764e4-ba3e-4187-9554-db7555c582f2"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:50:06.574881 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:50:06.574881 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:50:06.583725 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-1fcaa249-d458-4b31-87c0-ceac553afec5 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:06.584206 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-1fcaa249-d458-4b31-87c0-ceac553afec5 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:06.599912 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-1fcaa249-d458-4b31-87c0-ceac553afec5 service nova] Creating event network-changed:b62764e4-ba3e-4187-9554-db7555c582f2 for instance 727f4c83-6a75-4ccf-9f52-c2a83ecca801 on hv-cinder-79123 May 25 15:50:06.604793 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-1fcaa249-d458-4b31-87c0-ceac553afec5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035021 May 25 15:50:06.605376 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 603/1218] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:50:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:50:13.161395 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-fbde192e-d6f0-49c9-8dcc-686748ad9754 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:13.162083 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-fbde192e-d6f0-49c9-8dcc-686748ad9754 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:13.170755 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fbde192e-d6f0-49c9-8dcc-686748ad9754 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:13.171313 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fbde192e-d6f0-49c9-8dcc-686748ad9754 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:13.172213 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fbde192e-d6f0-49c9-8dcc-686748ad9754 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:13.172723 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-fbde192e-d6f0-49c9-8dcc-686748ad9754 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:13.340769 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.objects.instance [None req-fbde192e-d6f0-49c9-8dcc-686748ad9754 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lazy-loading 'services' on Instance uuid 2596d47a-e4cc-4252-9e3f-bf7559a4cbda {{(pid=112577) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:50:13.483375 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-fbde192e-d6f0-49c9-8dcc-686748ad9754 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda/os-volume_attachments/21bc77d6-cb38-436e-a9d2-b68c7800151b" status: 202 len: 0 microversion: 2.1 time: 0.327463 May 25 15:50:13.484259 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 616/1219] 10.222.0.36 () {58 vars in 1416 bytes} [Tue May 25 15:50:13 2021] DELETE /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda/os-volume_attachments/21bc77d6-cb38-436e-a9d2-b68c7800151b => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:50:17.033005 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-94d6e86c-d617-4e24-837f-f335bdb52b5c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:17.033379 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-94d6e86c-d617-4e24-837f-f335bdb52b5c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:17.041764 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-94d6e86c-d617-4e24-837f-f335bdb52b5c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:17.042410 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-94d6e86c-d617-4e24-837f-f335bdb52b5c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:17.043203 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-94d6e86c-d617-4e24-837f-f335bdb52b5c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:17.043648 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-94d6e86c-d617-4e24-837f-f335bdb52b5c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:17.108568 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-94d6e86c-d617-4e24-837f-f335bdb52b5c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Going to try to terminate instance {{(pid=112576) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:50:17.224048 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-94d6e86c-d617-4e24-837f-f335bdb52b5c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 204 len: 0 microversion: 2.1 time: 0.195929 May 25 15:50:17.224718 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 604/1220] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:50:17 2021] DELETE /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:50:17.233045 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d3ef4c63-adab-4fe6-af21-650e47eae06d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:17.233758 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d3ef4c63-adab-4fe6-af21-650e47eae06d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:17.242159 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d3ef4c63-adab-4fe6-af21-650e47eae06d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:17.242606 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d3ef4c63-adab-4fe6-af21-650e47eae06d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:17.243370 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d3ef4c63-adab-4fe6-af21-650e47eae06d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:17.243809 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d3ef4c63-adab-4fe6-af21-650e47eae06d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:17.446816 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d3ef4c63-adab-4fe6-af21-650e47eae06d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:17.455060 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d3ef4c63-adab-4fe6-af21-650e47eae06d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1515 microversion: 2.1 time: 0.226105 May 25 15:50:17.455630 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 617/1221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:17 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:18.473429 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-66eac227-5883-4451-a4ce-196755a9d7f3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:18.474142 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-66eac227-5883-4451-a4ce-196755a9d7f3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:18.482363 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-66eac227-5883-4451-a4ce-196755a9d7f3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:18.482809 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-66eac227-5883-4451-a4ce-196755a9d7f3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:18.483590 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-66eac227-5883-4451-a4ce-196755a9d7f3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:18.484070 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-66eac227-5883-4451-a4ce-196755a9d7f3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:18.998764 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-66eac227-5883-4451-a4ce-196755a9d7f3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:19.007722 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-66eac227-5883-4451-a4ce-196755a9d7f3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1515 microversion: 2.1 time: 0.539186 May 25 15:50:19.008355 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 605/1222] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:18 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1515 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:20.024757 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-69911101-cf45-4a9d-ad3e-d373ad4b70c4 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:20.025388 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-69911101-cf45-4a9d-ad3e-d373ad4b70c4 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:20.033036 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-69911101-cf45-4a9d-ad3e-d373ad4b70c4 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:20.034003 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-69911101-cf45-4a9d-ad3e-d373ad4b70c4 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:20.034801 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-69911101-cf45-4a9d-ad3e-d373ad4b70c4 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:20.035257 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-69911101-cf45-4a9d-ad3e-d373ad4b70c4 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:20.242494 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-69911101-cf45-4a9d-ad3e-d373ad4b70c4 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:20.252184 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-69911101-cf45-4a9d-ad3e-d373ad4b70c4 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1515 microversion: 2.1 time: 0.231177 May 25 15:50:20.252345 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:20.252838 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 618/1223] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:20 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:20.252940 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:20.257792 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-acf805f3-d2bf-4334-9944-88d9bc9aec9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b8d3b0-aceb-4f56-a13d-7d0696f42901", "tag": "7ae06ec7-6469-494a-b223-ce3de0a0e2da"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:50:20.259723 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:50:20.259723 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:50:20.267089 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:20.268512 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:20.269148 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-acf805f3-d2bf-4334-9944-88d9bc9aec9a service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:20.269371 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:20.269756 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-acf805f3-d2bf-4334-9944-88d9bc9aec9a service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:20.270072 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:20.286769 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-acf805f3-d2bf-4334-9944-88d9bc9aec9a service nova] Creating event network-changed:7ae06ec7-6469-494a-b223-ce3de0a0e2da for instance a4b8d3b0-aceb-4f56-a13d-7d0696f42901 on hv-cinder-79123 May 25 15:50:20.291808 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-acf805f3-d2bf-4334-9944-88d9bc9aec9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037493 May 25 15:50:20.292734 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 619/1224] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:50:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:50:20.336453 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Going to try to terminate instance {{(pid=112576) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:50:20.455821 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 204 len: 0 microversion: 2.1 time: 0.207295 May 25 15:50:20.456918 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 606/1225] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:50:20 2021] DELETE /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 15:50:20.465818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-93010a0a-67db-4070-a7a0-bd26022472a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:20.466658 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-93010a0a-67db-4070-a7a0-bd26022472a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:20.474578 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-93010a0a-67db-4070-a7a0-bd26022472a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:20.475125 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-93010a0a-67db-4070-a7a0-bd26022472a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:20.475970 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-93010a0a-67db-4070-a7a0-bd26022472a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:20.476415 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-93010a0a-67db-4070-a7a0-bd26022472a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:20.677246 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-93010a0a-67db-4070-a7a0-bd26022472a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:20.685739 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-93010a0a-67db-4070-a7a0-bd26022472a0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.224381 May 25 15:50:20.686253 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 620/1226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:20 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:21.270309 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d85efb24-3598-4533-9c84-0898125de5fd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:21.271279 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d85efb24-3598-4533-9c84-0898125de5fd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:21.278991 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d85efb24-3598-4533-9c84-0898125de5fd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:21.279710 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d85efb24-3598-4533-9c84-0898125de5fd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:21.280279 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d85efb24-3598-4533-9c84-0898125de5fd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:21.280728 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d85efb24-3598-4533-9c84-0898125de5fd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:21.487226 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d85efb24-3598-4533-9c84-0898125de5fd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:21.496473 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d85efb24-3598-4533-9c84-0898125de5fd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1515 microversion: 2.1 time: 0.231150 May 25 15:50:21.497736 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 607/1227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:21 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:50:21.702870 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d1de50a2-3e17-4df1-b9d8-36bc639b566b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:21.703495 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d1de50a2-3e17-4df1-b9d8-36bc639b566b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:21.711223 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1de50a2-3e17-4df1-b9d8-36bc639b566b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:21.711684 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1de50a2-3e17-4df1-b9d8-36bc639b566b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:21.712499 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1de50a2-3e17-4df1-b9d8-36bc639b566b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:21.713095 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1de50a2-3e17-4df1-b9d8-36bc639b566b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:21.906700 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d1de50a2-3e17-4df1-b9d8-36bc639b566b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:21.916455 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d1de50a2-3e17-4df1-b9d8-36bc639b566b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.217315 May 25 15:50:21.917032 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 621/1228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:21 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:22.514690 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-5adc47e8-1c78-4117-8309-a6b2390c743c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:22.515284 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-5adc47e8-1c78-4117-8309-a6b2390c743c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:22.523602 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5adc47e8-1c78-4117-8309-a6b2390c743c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:22.524101 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5adc47e8-1c78-4117-8309-a6b2390c743c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:22.524856 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5adc47e8-1c78-4117-8309-a6b2390c743c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:22.525291 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-5adc47e8-1c78-4117-8309-a6b2390c743c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:22.719783 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-5adc47e8-1c78-4117-8309-a6b2390c743c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:22.728503 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-5adc47e8-1c78-4117-8309-a6b2390c743c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1515 microversion: 2.1 time: 0.217503 May 25 15:50:22.729071 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 608/1229] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:22 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:22.934015 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-2feab133-e146-4616-aa3a-f1cfb31a58af tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:22.934646 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-2feab133-e146-4616-aa3a-f1cfb31a58af tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:22.942618 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2feab133-e146-4616-aa3a-f1cfb31a58af tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:22.943080 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2feab133-e146-4616-aa3a-f1cfb31a58af tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:22.943888 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2feab133-e146-4616-aa3a-f1cfb31a58af tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:22.944333 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-2feab133-e146-4616-aa3a-f1cfb31a58af tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:23.388491 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-2feab133-e146-4616-aa3a-f1cfb31a58af tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:23.397340 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-2feab133-e146-4616-aa3a-f1cfb31a58af tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1569 microversion: 2.1 time: 0.466988 May 25 15:50:23.397864 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 622/1230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:22 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1569 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:23.745314 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-dc78fd10-4464-40a1-8f95-1fb6c5ac323a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:23.745943 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-dc78fd10-4464-40a1-8f95-1fb6c5ac323a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:23.753261 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dc78fd10-4464-40a1-8f95-1fb6c5ac323a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:23.753841 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dc78fd10-4464-40a1-8f95-1fb6c5ac323a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:23.754669 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dc78fd10-4464-40a1-8f95-1fb6c5ac323a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:23.755115 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-dc78fd10-4464-40a1-8f95-1fb6c5ac323a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:23.974706 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-dc78fd10-4464-40a1-8f95-1fb6c5ac323a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:23.983190 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-dc78fd10-4464-40a1-8f95-1fb6c5ac323a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1515 microversion: 2.1 time: 0.241826 May 25 15:50:23.983766 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 609/1231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:23 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:24.414893 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ffc81ea8-5f0f-4323-9b5d-ca65c51280c7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:24.415780 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ffc81ea8-5f0f-4323-9b5d-ca65c51280c7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:24.423171 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ffc81ea8-5f0f-4323-9b5d-ca65c51280c7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:24.423635 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ffc81ea8-5f0f-4323-9b5d-ca65c51280c7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:24.424464 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ffc81ea8-5f0f-4323-9b5d-ca65c51280c7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:24.424913 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ffc81ea8-5f0f-4323-9b5d-ca65c51280c7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:24.594511 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-5496df7e-1ac1-4a53-b69d-a12ecf43428e req-5a31ada3-3e39-44dc-b5f4-ad79391b7d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2596d47a-e4cc-4252-9e3f-bf7559a4cbda", "name": "network-vif-deleted", "tag": "1edf8be0-5889-4766-ae81-82de066f9110"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:50:24.596567 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:50:24.596567 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:50:24.604908 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-5496df7e-1ac1-4a53-b69d-a12ecf43428e req-5a31ada3-3e39-44dc-b5f4-ad79391b7d3d service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:24.605362 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-5496df7e-1ac1-4a53-b69d-a12ecf43428e req-5a31ada3-3e39-44dc-b5f4-ad79391b7d3d service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:24.622137 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-5496df7e-1ac1-4a53-b69d-a12ecf43428e req-5a31ada3-3e39-44dc-b5f4-ad79391b7d3d service nova] Creating event network-vif-deleted:1edf8be0-5889-4766-ae81-82de066f9110 for instance 2596d47a-e4cc-4252-9e3f-bf7559a4cbda on hv-cinder-79123 May 25 15:50:24.627005 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-5496df7e-1ac1-4a53-b69d-a12ecf43428e req-5a31ada3-3e39-44dc-b5f4-ad79391b7d3d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036147 May 25 15:50:24.627613 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 610/1232] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:50:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:50:24.686711 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ffc81ea8-5f0f-4323-9b5d-ca65c51280c7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:24.695041 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ffc81ea8-5f0f-4323-9b5d-ca65c51280c7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1450 microversion: 2.1 time: 0.284244 May 25 15:50:24.695615 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 623/1233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:24 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1450 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:25.001049 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6b6821d8-131e-490a-a96a-eaa99f84b361 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:25.001770 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6b6821d8-131e-490a-a96a-eaa99f84b361 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:25.009870 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b6821d8-131e-490a-a96a-eaa99f84b361 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:25.010336 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b6821d8-131e-490a-a96a-eaa99f84b361 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:25.011118 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b6821d8-131e-490a-a96a-eaa99f84b361 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:25.011566 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6b6821d8-131e-490a-a96a-eaa99f84b361 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:25.124296 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6b6821d8-131e-490a-a96a-eaa99f84b361 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:25.133076 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6b6821d8-131e-490a-a96a-eaa99f84b361 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1473 microversion: 2.1 time: 0.136211 May 25 15:50:25.133637 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 611/1234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:24 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1473 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:25.712350 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5960b1d7-e16a-45bc-b8bf-7b3ab2b0c7e6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:25.712906 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5960b1d7-e16a-45bc-b8bf-7b3ab2b0c7e6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:25.720238 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5960b1d7-e16a-45bc-b8bf-7b3ab2b0c7e6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:25.720699 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5960b1d7-e16a-45bc-b8bf-7b3ab2b0c7e6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:25.722096 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5960b1d7-e16a-45bc-b8bf-7b3ab2b0c7e6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:25.722541 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5960b1d7-e16a-45bc-b8bf-7b3ab2b0c7e6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:25.917647 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5960b1d7-e16a-45bc-b8bf-7b3ab2b0c7e6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:25.926534 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5960b1d7-e16a-45bc-b8bf-7b3ab2b0c7e6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1450 microversion: 2.1 time: 0.217970 May 25 15:50:25.927117 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 624/1235] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:25 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1450 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:26.150019 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-a34af552-1848-4e7c-8ffa-61d5a827f1fc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:26.150647 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-a34af552-1848-4e7c-8ffa-61d5a827f1fc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:26.158131 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a34af552-1848-4e7c-8ffa-61d5a827f1fc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:26.158594 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a34af552-1848-4e7c-8ffa-61d5a827f1fc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:26.159368 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a34af552-1848-4e7c-8ffa-61d5a827f1fc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:26.159814 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-a34af552-1848-4e7c-8ffa-61d5a827f1fc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:26.273126 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-a34af552-1848-4e7c-8ffa-61d5a827f1fc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:26.281627 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-a34af552-1848-4e7c-8ffa-61d5a827f1fc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1473 microversion: 2.1 time: 0.135346 May 25 15:50:26.282199 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 612/1236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:26 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1473 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:50:26.945228 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5bc0ebaa-45c6-4c30-a170-38394425667f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:26.945893 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5bc0ebaa-45c6-4c30-a170-38394425667f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:26.953399 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5bc0ebaa-45c6-4c30-a170-38394425667f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:26.953863 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5bc0ebaa-45c6-4c30-a170-38394425667f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:26.954651 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5bc0ebaa-45c6-4c30-a170-38394425667f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:26.955093 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5bc0ebaa-45c6-4c30-a170-38394425667f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:27.149599 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5bc0ebaa-45c6-4c30-a170-38394425667f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:27.158021 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5bc0ebaa-45c6-4c30-a170-38394425667f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1450 microversion: 2.1 time: 0.218207 May 25 15:50:27.159467 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 625/1237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:26 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1450 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:27.298313 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-c513f1d9-5623-4750-a580-f10bd9957105 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:27.298941 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-c513f1d9-5623-4750-a580-f10bd9957105 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:27.306279 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c513f1d9-5623-4750-a580-f10bd9957105 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:27.306742 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c513f1d9-5623-4750-a580-f10bd9957105 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:27.307530 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c513f1d9-5623-4750-a580-f10bd9957105 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:27.308014 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-c513f1d9-5623-4750-a580-f10bd9957105 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:27.426760 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-c513f1d9-5623-4750-a580-f10bd9957105 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:27.434967 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-c513f1d9-5623-4750-a580-f10bd9957105 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1303 microversion: 2.1 time: 0.140500 May 25 15:50:27.435537 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 613/1238] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:27 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:28.174804 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-8bb97f56-6e80-4f8f-b7e6-746c4685c7d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:28.175366 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-8bb97f56-6e80-4f8f-b7e6-746c4685c7d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:28.182651 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8bb97f56-6e80-4f8f-b7e6-746c4685c7d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:28.183115 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8bb97f56-6e80-4f8f-b7e6-746c4685c7d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:28.183912 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8bb97f56-6e80-4f8f-b7e6-746c4685c7d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:28.184358 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-8bb97f56-6e80-4f8f-b7e6-746c4685c7d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:28.385763 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-8bb97f56-6e80-4f8f-b7e6-746c4685c7d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:28.394218 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-8bb97f56-6e80-4f8f-b7e6-746c4685c7d2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1450 microversion: 2.1 time: 0.223238 May 25 15:50:28.394782 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 626/1239] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:28 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1450 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:28.455875 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-70196ba9-1210-4a2d-a5e4-f54f7aa2fdec tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:28.457174 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-70196ba9-1210-4a2d-a5e4-f54f7aa2fdec tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:28.466771 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-70196ba9-1210-4a2d-a5e4-f54f7aa2fdec tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:28.467222 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-70196ba9-1210-4a2d-a5e4-f54f7aa2fdec tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:28.468044 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-70196ba9-1210-4a2d-a5e4-f54f7aa2fdec tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:28.468506 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-70196ba9-1210-4a2d-a5e4-f54f7aa2fdec tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:28.540056 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-70196ba9-1210-4a2d-a5e4-f54f7aa2fdec tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:28.540507 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-70196ba9-1210-4a2d-a5e4-f54f7aa2fdec tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:28.540985 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-70196ba9-1210-4a2d-a5e4-f54f7aa2fdec tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lazy-loading 'fault' on Instance uuid 2596d47a-e4cc-4252-9e3f-bf7559a4cbda {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:50:28.599051 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-70196ba9-1210-4a2d-a5e4-f54f7aa2fdec tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:28.607235 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-70196ba9-1210-4a2d-a5e4-f54f7aa2fdec tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 200 len: 1308 microversion: 2.1 time: 0.159542 May 25 15:50:28.607799 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 614/1240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:28 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:29.411914 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-759bef4b-625f-4d7d-a501-2ef5ebc956b4 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:29.412541 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-759bef4b-625f-4d7d-a501-2ef5ebc956b4 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:29.419764 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-759bef4b-625f-4d7d-a501-2ef5ebc956b4 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:29.420256 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-759bef4b-625f-4d7d-a501-2ef5ebc956b4 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:29.421032 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-759bef4b-625f-4d7d-a501-2ef5ebc956b4 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:29.421500 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-759bef4b-625f-4d7d-a501-2ef5ebc956b4 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:29.624345 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0d3b488c-0ce4-4831-ad29-813da091c3c7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:29.624916 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-0d3b488c-0ce4-4831-ad29-813da091c3c7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 2596d47a-e4cc-4252-9e3f-bf7559a4cbda] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:29.632531 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0d3b488c-0ce4-4831-ad29-813da091c3c7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:29.632995 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0d3b488c-0ce4-4831-ad29-813da091c3c7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:29.633802 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0d3b488c-0ce4-4831-ad29-813da091c3c7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:29.634249 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-0d3b488c-0ce4-4831-ad29-813da091c3c7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:29.687200 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-0d3b488c-0ce4-4831-ad29-813da091c3c7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] HTTP exception thrown: Instance 2596d47a-e4cc-4252-9e3f-bf7559a4cbda could not be found. May 25 15:50:29.687829 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-0d3b488c-0ce4-4831-ad29-813da091c3c7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Returning 404 to user: Instance 2596d47a-e4cc-4252-9e3f-bf7559a4cbda could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:50:29.688719 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-0d3b488c-0ce4-4831-ad29-813da091c3c7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda" status: 404 len: 111 microversion: 2.1 time: 0.068523 May 25 15:50:29.689286 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 615/1241] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:29 2021] GET /compute/v2.1/servers/2596d47a-e4cc-4252-9e3f-bf7559a4cbda => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:50:29.772012 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-759bef4b-625f-4d7d-a501-2ef5ebc956b4 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:29.781419 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-759bef4b-625f-4d7d-a501-2ef5ebc956b4 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1450 microversion: 2.1 time: 0.373184 May 25 15:50:29.782009 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 627/1242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:29 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1450 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:30.798479 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:30.799140 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:30.806801 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:30.807360 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:30.808382 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:30.808827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:31.040673 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:31.049055 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1450 microversion: 2.1 time: 0.254364 May 25 15:50:31.049551 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 616/1243] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:30 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1450 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:31.498332 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-1c1bf52c-7ce7-480f-b6d1-2a27d1861e71 req-107ef0e5-65bb-49fb-bc66-de1b6bcd0330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b8d3b0-aceb-4f56-a13d-7d0696f42901", "name": "network-vif-deleted", "tag": "7ae06ec7-6469-494a-b223-ce3de0a0e2da"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:50:31.499909 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:50:31.499909 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:50:31.508001 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-1c1bf52c-7ce7-480f-b6d1-2a27d1861e71 req-107ef0e5-65bb-49fb-bc66-de1b6bcd0330 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:31.508448 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-1c1bf52c-7ce7-480f-b6d1-2a27d1861e71 req-107ef0e5-65bb-49fb-bc66-de1b6bcd0330 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:31.524715 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-1c1bf52c-7ce7-480f-b6d1-2a27d1861e71 req-107ef0e5-65bb-49fb-bc66-de1b6bcd0330 service nova] Creating event network-vif-deleted:7ae06ec7-6469-494a-b223-ce3de0a0e2da for instance a4b8d3b0-aceb-4f56-a13d-7d0696f42901 on hv-cinder-79123 May 25 15:50:31.529466 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-1c1bf52c-7ce7-480f-b6d1-2a27d1861e71 req-107ef0e5-65bb-49fb-bc66-de1b6bcd0330 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162174 May 25 15:50:31.530030 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 628/1244] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:50:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:50:32.066657 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-edf6d1e0-7bec-4c80-beb5-1a54ed8f533b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:32.067294 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-edf6d1e0-7bec-4c80-beb5-1a54ed8f533b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:32.082108 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-edf6d1e0-7bec-4c80-beb5-1a54ed8f533b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:32.082577 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-edf6d1e0-7bec-4c80-beb5-1a54ed8f533b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:32.084537 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-edf6d1e0-7bec-4c80-beb5-1a54ed8f533b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:32.084997 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-edf6d1e0-7bec-4c80-beb5-1a54ed8f533b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:32.203697 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-edf6d1e0-7bec-4c80-beb5-1a54ed8f533b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:32.211974 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-edf6d1e0-7bec-4c80-beb5-1a54ed8f533b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1383 microversion: 2.1 time: 0.149498 May 25 15:50:32.212556 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 617/1245] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:32 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1383 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:33.229183 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-4b2474a9-42b0-4962-bbaf-a64db1698ad1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:33.229909 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-4b2474a9-42b0-4962-bbaf-a64db1698ad1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:33.237505 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4b2474a9-42b0-4962-bbaf-a64db1698ad1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:33.238146 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4b2474a9-42b0-4962-bbaf-a64db1698ad1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:33.238933 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4b2474a9-42b0-4962-bbaf-a64db1698ad1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:33.239382 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-4b2474a9-42b0-4962-bbaf-a64db1698ad1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:33.366947 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-4b2474a9-42b0-4962-bbaf-a64db1698ad1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:33.375235 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-4b2474a9-42b0-4962-bbaf-a64db1698ad1 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1219 microversion: 2.1 time: 0.150228 May 25 15:50:33.375809 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 629/1246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:33 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:34.392571 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ad855b35-ff44-4dfa-8088-54e9409b8288 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:34.393117 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ad855b35-ff44-4dfa-8088-54e9409b8288 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:34.401315 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ad855b35-ff44-4dfa-8088-54e9409b8288 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:34.401810 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ad855b35-ff44-4dfa-8088-54e9409b8288 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:34.402752 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ad855b35-ff44-4dfa-8088-54e9409b8288 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:34.403313 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ad855b35-ff44-4dfa-8088-54e9409b8288 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:34.530316 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ad855b35-ff44-4dfa-8088-54e9409b8288 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279538b4ffde4d39a352b2594cc4bd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:34.538868 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ad855b35-ff44-4dfa-8088-54e9409b8288 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 200 len: 1219 microversion: 2.1 time: 0.150460 May 25 15:50:34.539436 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 618/1247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:34 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:35.280982 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:35.281471 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:35.289353 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:35.289807 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:35.290584 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:35.291027 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:35.362442 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Going to try to terminate instance {{(pid=112577) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:50:35.473129 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 204 len: 0 microversion: 2.1 time: 0.195525 May 25 15:50:35.473747 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 630/1248] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:50:35 2021] DELETE /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:50:35.482727 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-95949289-ad5d-4513-9571-e98831b17f00 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:35.483418 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-95949289-ad5d-4513-9571-e98831b17f00 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:35.490802 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-95949289-ad5d-4513-9571-e98831b17f00 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:35.491277 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-95949289-ad5d-4513-9571-e98831b17f00 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:35.492085 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-95949289-ad5d-4513-9571-e98831b17f00 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:35.492529 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-95949289-ad5d-4513-9571-e98831b17f00 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:35.556084 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c60f4f00-861d-452e-89c1-67eec7183d4e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:35.557061 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-c60f4f00-861d-452e-89c1-67eec7183d4e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] [instance: a4b8d3b0-aceb-4f56-a13d-7d0696f42901] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:35.564434 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c60f4f00-861d-452e-89c1-67eec7183d4e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:35.564889 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c60f4f00-861d-452e-89c1-67eec7183d4e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:35.566244 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c60f4f00-861d-452e-89c1-67eec7183d4e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:35.566685 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-c60f4f00-861d-452e-89c1-67eec7183d4e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:35.617194 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-c60f4f00-861d-452e-89c1-67eec7183d4e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] HTTP exception thrown: Instance a4b8d3b0-aceb-4f56-a13d-7d0696f42901 could not be found. May 25 15:50:35.617804 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-c60f4f00-861d-452e-89c1-67eec7183d4e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Returning 404 to user: Instance a4b8d3b0-aceb-4f56-a13d-7d0696f42901 could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:50:35.618653 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-c60f4f00-861d-452e-89c1-67eec7183d4e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901" status: 404 len: 111 microversion: 2.1 time: 0.066948 May 25 15:50:35.619413 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 631/1249] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:35 2021] GET /compute/v2.1/servers/a4b8d3b0-aceb-4f56-a13d-7d0696f42901 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:50:35.694626 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-95949289-ad5d-4513-9571-e98831b17f00 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:35.703109 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-95949289-ad5d-4513-9571-e98831b17f00 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1514 microversion: 2.1 time: 0.225209 May 25 15:50:35.703686 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 619/1250] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:35 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:35.843187 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d5e3965c-d635-4865-b84b-efb378c6af98 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling method '.version_select at 0x7f0884693b80>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:35.860538 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d5e3965c-d635-4865-b84b-efb378c6af98 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2103351507" status: 202 len: 0 microversion: 2.1 time: 0.020950 May 25 15:50:35.861111 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 632/1251] 10.222.0.36 () {58 vars in 1254 bytes} [Tue May 25 15:50:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2103351507 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:50:36.720371 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e638481e-c28b-48f2-a1e5-f1bc30d12d61 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:36.721016 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e638481e-c28b-48f2-a1e5-f1bc30d12d61 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:36.729248 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e638481e-c28b-48f2-a1e5-f1bc30d12d61 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:36.729733 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e638481e-c28b-48f2-a1e5-f1bc30d12d61 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:36.730513 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e638481e-c28b-48f2-a1e5-f1bc30d12d61 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:36.731013 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e638481e-c28b-48f2-a1e5-f1bc30d12d61 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:36.932863 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-e638481e-c28b-48f2-a1e5-f1bc30d12d61 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:36.941250 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e638481e-c28b-48f2-a1e5-f1bc30d12d61 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1514 microversion: 2.1 time: 0.224745 May 25 15:50:36.941826 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 620/1252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:36 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:37.958651 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-d1d52513-094d-4c62-9d8e-542d0acde141 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:37.959286 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-d1d52513-094d-4c62-9d8e-542d0acde141 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:37.967614 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1d52513-094d-4c62-9d8e-542d0acde141 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:37.968286 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1d52513-094d-4c62-9d8e-542d0acde141 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:37.969085 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1d52513-094d-4c62-9d8e-542d0acde141 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:37.969532 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-d1d52513-094d-4c62-9d8e-542d0acde141 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:38.657368 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-d1d52513-094d-4c62-9d8e-542d0acde141 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:38.666340 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-d1d52513-094d-4c62-9d8e-542d0acde141 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1514 microversion: 2.1 time: 0.711596 May 25 15:50:38.676983 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 633/1253] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:37 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1514 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:39.682557 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-90dae2e1-2810-4675-aeb8-15f94edaa5bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:39.683168 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-90dae2e1-2810-4675-aeb8-15f94edaa5bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:39.690867 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-90dae2e1-2810-4675-aeb8-15f94edaa5bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:39.691319 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-90dae2e1-2810-4675-aeb8-15f94edaa5bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:39.692130 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-90dae2e1-2810-4675-aeb8-15f94edaa5bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:39.692566 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-90dae2e1-2810-4675-aeb8-15f94edaa5bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:39.840339 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-90dae2e1-2810-4675-aeb8-15f94edaa5bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:39.849553 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-90dae2e1-2810-4675-aeb8-15f94edaa5bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 200 len: 1472 microversion: 2.1 time: 0.170700 May 25 15:50:39.850577 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 621/1254] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:39 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 1472 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:40.030551 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-e0dbf511-b27f-4921-bfe1-559396d8c9c1 req-bb785d5e-89ce-4642-98d7-dff6f0ca1b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0", "name": "network-vif-deleted", "tag": "62e410a2-9c20-453a-864a-5ef7c5d2a2fd"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:50:40.032322 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:50:40.032322 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:50:40.041798 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-e0dbf511-b27f-4921-bfe1-559396d8c9c1 req-bb785d5e-89ce-4642-98d7-dff6f0ca1b94 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:40.042263 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-e0dbf511-b27f-4921-bfe1-559396d8c9c1 req-bb785d5e-89ce-4642-98d7-dff6f0ca1b94 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:40.063604 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-e0dbf511-b27f-4921-bfe1-559396d8c9c1 req-bb785d5e-89ce-4642-98d7-dff6f0ca1b94 service nova] Creating event network-vif-deleted:62e410a2-9c20-453a-864a-5ef7c5d2a2fd for instance 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 on hv-cinder-79123 May 25 15:50:40.068859 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-e0dbf511-b27f-4921-bfe1-559396d8c9c1 req-bb785d5e-89ce-4642-98d7-dff6f0ca1b94 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042648 May 25 15:50:40.069505 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 634/1255] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:50:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:50:40.867141 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7e48fc7a-7edf-4af9-86d6-26c8ee8cbec1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:40.868005 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-7e48fc7a-7edf-4af9-86d6-26c8ee8cbec1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:40.878813 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7e48fc7a-7edf-4af9-86d6-26c8ee8cbec1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:40.879676 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7e48fc7a-7edf-4af9-86d6-26c8ee8cbec1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:40.880729 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7e48fc7a-7edf-4af9-86d6-26c8ee8cbec1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:40.881387 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-7e48fc7a-7edf-4af9-86d6-26c8ee8cbec1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:40.950263 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-7e48fc7a-7edf-4af9-86d6-26c8ee8cbec1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] HTTP exception thrown: Instance 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 could not be found. May 25 15:50:40.951674 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7e48fc7a-7edf-4af9-86d6-26c8ee8cbec1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Returning 404 to user: Instance 7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:50:40.952555 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7e48fc7a-7edf-4af9-86d6-26c8ee8cbec1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0" status: 404 len: 111 microversion: 2.1 time: 0.089608 May 25 15:50:40.953073 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 622/1256] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:40 2021] GET /compute/v2.1/servers/7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:50:40.962614 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-35fec76b-227d-4912-b8d8-a23af12f1846 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:40.963283 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-35fec76b-227d-4912-b8d8-a23af12f1846 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:40.971897 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-35fec76b-227d-4912-b8d8-a23af12f1846 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:40.972499 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-35fec76b-227d-4912-b8d8-a23af12f1846 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:40.973465 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-35fec76b-227d-4912-b8d8-a23af12f1846 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:40.974019 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-35fec76b-227d-4912-b8d8-a23af12f1846 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:41.052903 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-35fec76b-227d-4912-b8d8-a23af12f1846 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Going to try to terminate instance {{(pid=112577) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:50:41.174227 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-35fec76b-227d-4912-b8d8-a23af12f1846 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 204 len: 0 microversion: 2.1 time: 0.215543 May 25 15:50:41.178848 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 635/1257] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:50:40 2021] DELETE /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:50:41.191142 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-d91560d0-d041-4797-a045-1a718afa8d68 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:41.191746 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-d91560d0-d041-4797-a045-1a718afa8d68 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:41.199832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d91560d0-d041-4797-a045-1a718afa8d68 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:41.200339 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d91560d0-d041-4797-a045-1a718afa8d68 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:41.201141 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d91560d0-d041-4797-a045-1a718afa8d68 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:41.201633 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-d91560d0-d041-4797-a045-1a718afa8d68 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:41.423666 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-d91560d0-d041-4797-a045-1a718afa8d68 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:41.433302 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-d91560d0-d041-4797-a045-1a718afa8d68 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1513 microversion: 2.1 time: 0.251676 May 25 15:50:41.433894 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 623/1258] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:41 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:42.451493 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:42.452243 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:42.460372 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:42.460828 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:42.461611 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:42.462046 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:42.771299 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:42.779795 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1513 microversion: 2.1 time: 0.332830 May 25 15:50:42.780476 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 636/1259] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:42 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1513 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:43.796703 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bd030d94-6973-4deb-afb1-0b0587e3ee3a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:43.797492 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bd030d94-6973-4deb-afb1-0b0587e3ee3a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:43.805577 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd030d94-6973-4deb-afb1-0b0587e3ee3a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:43.806123 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd030d94-6973-4deb-afb1-0b0587e3ee3a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:43.806931 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd030d94-6973-4deb-afb1-0b0587e3ee3a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:43.807403 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bd030d94-6973-4deb-afb1-0b0587e3ee3a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:44.002958 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-bd030d94-6973-4deb-afb1-0b0587e3ee3a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:44.011346 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bd030d94-6973-4deb-afb1-0b0587e3ee3a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1513 microversion: 2.1 time: 0.218463 May 25 15:50:44.011961 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 624/1260] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:43 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:44.712223 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-86165729-3963-4493-ba05-f20d4851afa3 req-e6734cc4-87bd-48d5-83c5-7b66c1cb2101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c381c82c-5123-4915-b9b2-8f65b8ffaf9b", "name": "network-vif-deleted", "tag": "6fd10c0b-7953-4682-8b93-6b38d31fbca5"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:50:44.714334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:50:44.714334 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:50:44.723472 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-86165729-3963-4493-ba05-f20d4851afa3 req-e6734cc4-87bd-48d5-83c5-7b66c1cb2101 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:44.723935 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-86165729-3963-4493-ba05-f20d4851afa3 req-e6734cc4-87bd-48d5-83c5-7b66c1cb2101 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:44.743639 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-86165729-3963-4493-ba05-f20d4851afa3 req-e6734cc4-87bd-48d5-83c5-7b66c1cb2101 service nova] Creating event network-vif-deleted:6fd10c0b-7953-4682-8b93-6b38d31fbca5 for instance c381c82c-5123-4915-b9b2-8f65b8ffaf9b on hv-cinder-79123 May 25 15:50:44.748245 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-86165729-3963-4493-ba05-f20d4851afa3 req-e6734cc4-87bd-48d5-83c5-7b66c1cb2101 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039619 May 25 15:50:44.748844 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 637/1261] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:50:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:50:45.029454 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-ed8892b8-f0e9-478a-ac9b-22d1a64fbed7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:45.030223 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-ed8892b8-f0e9-478a-ac9b-22d1a64fbed7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:45.037579 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed8892b8-f0e9-478a-ac9b-22d1a64fbed7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:45.038042 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed8892b8-f0e9-478a-ac9b-22d1a64fbed7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:45.038838 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed8892b8-f0e9-478a-ac9b-22d1a64fbed7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:45.039398 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed8892b8-f0e9-478a-ac9b-22d1a64fbed7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:45.109888 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed8892b8-f0e9-478a-ac9b-22d1a64fbed7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:45.110355 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-ed8892b8-f0e9-478a-ac9b-22d1a64fbed7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:45.110826 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.objects.instance [None req-ed8892b8-f0e9-478a-ac9b-22d1a64fbed7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lazy-loading 'fault' on Instance uuid c381c82c-5123-4915-b9b2-8f65b8ffaf9b {{(pid=112576) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 25 15:50:45.171136 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-ed8892b8-f0e9-478a-ac9b-22d1a64fbed7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:45.180144 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-ed8892b8-f0e9-478a-ac9b-22d1a64fbed7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 200 len: 1307 microversion: 2.1 time: 0.154377 May 25 15:50:45.180977 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 625/1262] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:45 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:46.197938 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-eb45e6b5-0f5c-405d-a895-c6cb9e65e7e7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:46.198571 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-eb45e6b5-0f5c-405d-a895-c6cb9e65e7e7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: c381c82c-5123-4915-b9b2-8f65b8ffaf9b] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:46.208065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-eb45e6b5-0f5c-405d-a895-c6cb9e65e7e7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:46.208529 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-eb45e6b5-0f5c-405d-a895-c6cb9e65e7e7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:46.209321 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-eb45e6b5-0f5c-405d-a895-c6cb9e65e7e7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:46.209764 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-eb45e6b5-0f5c-405d-a895-c6cb9e65e7e7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:46.414544 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-eb45e6b5-0f5c-405d-a895-c6cb9e65e7e7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] HTTP exception thrown: Instance c381c82c-5123-4915-b9b2-8f65b8ffaf9b could not be found. May 25 15:50:46.415264 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-eb45e6b5-0f5c-405d-a895-c6cb9e65e7e7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Returning 404 to user: Instance c381c82c-5123-4915-b9b2-8f65b8ffaf9b could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:50:46.416391 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-eb45e6b5-0f5c-405d-a895-c6cb9e65e7e7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b" status: 404 len: 111 microversion: 2.1 time: 0.223145 May 25 15:50:46.417236 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 638/1263] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:46 2021] GET /compute/v2.1/servers/c381c82c-5123-4915-b9b2-8f65b8ffaf9b => generated 111 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:50:47.663064 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:47.663689 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:47.671073 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:47.671645 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:47.672589 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:47.673138 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:47.741841 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Going to try to terminate instance {{(pid=112576) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:50:47.875418 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 204 len: 0 microversion: 2.1 time: 0.215615 May 25 15:50:47.877331 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 626/1264] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:50:47 2021] DELETE /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:50:47.884846 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:47.885475 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:47.893853 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:47.894305 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:47.895082 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:47.895515 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:48.147086 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:48.158773 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1514 microversion: 2.1 time: 0.277440 May 25 15:50:48.159881 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 639/1265] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:47 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1514 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:49.177193 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-6bcaf14a-8fc3-47c2-8c83-b009ae5fdab7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:49.177910 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-6bcaf14a-8fc3-47c2-8c83-b009ae5fdab7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:49.185231 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6bcaf14a-8fc3-47c2-8c83-b009ae5fdab7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:49.185778 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6bcaf14a-8fc3-47c2-8c83-b009ae5fdab7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:49.193081 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6bcaf14a-8fc3-47c2-8c83-b009ae5fdab7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:49.193595 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-6bcaf14a-8fc3-47c2-8c83-b009ae5fdab7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:49.415676 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-6bcaf14a-8fc3-47c2-8c83-b009ae5fdab7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:49.423883 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-6bcaf14a-8fc3-47c2-8c83-b009ae5fdab7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1514 microversion: 2.1 time: 0.251307 May 25 15:50:49.424504 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 627/1266] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:49 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:50.441093 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-ca8f5bfb-1592-40d7-be1d-dd0f1156ab14 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:50.441722 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-ca8f5bfb-1592-40d7-be1d-dd0f1156ab14 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:50.448929 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bfb-1592-40d7-be1d-dd0f1156ab14 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:50.449386 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bfb-1592-40d7-be1d-dd0f1156ab14 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:50.450170 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bfb-1592-40d7-be1d-dd0f1156ab14 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:50.450616 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bfb-1592-40d7-be1d-dd0f1156ab14 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:50.476899 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-f9112a57-1b2f-4810-9ac1-07a998a5265e req-451e1030-6bcf-4d01-aa4f-fd405796c4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef24ea0-a934-410a-8440-614ba104efd6", "name": "network-vif-deleted", "tag": "03200337-3a8d-470d-b921-cf873c06c54e"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:50:50.478556 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:50:50.478556 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:50:50.493449 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-f9112a57-1b2f-4810-9ac1-07a998a5265e req-451e1030-6bcf-4d01-aa4f-fd405796c4e3 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:50.493934 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-f9112a57-1b2f-4810-9ac1-07a998a5265e req-451e1030-6bcf-4d01-aa4f-fd405796c4e3 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:50.511547 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-f9112a57-1b2f-4810-9ac1-07a998a5265e req-451e1030-6bcf-4d01-aa4f-fd405796c4e3 service nova] Creating event network-vif-deleted:03200337-3a8d-470d-b921-cf873c06c54e for instance fef24ea0-a934-410a-8440-614ba104efd6 on hv-cinder-79123 May 25 15:50:50.516107 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-f9112a57-1b2f-4810-9ac1-07a998a5265e req-451e1030-6bcf-4d01-aa4f-fd405796c4e3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042768 May 25 15:50:50.516703 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 628/1267] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:50:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:50:50.585815 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-ca8f5bfb-1592-40d7-be1d-dd0f1156ab14 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4361d882e741fe993a2856b105ae74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1f97f6101d466a9c224075352387d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:50:50.594210 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-ca8f5bfb-1592-40d7-be1d-dd0f1156ab14 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 200 len: 1472 microversion: 2.1 time: 0.157480 May 25 15:50:50.594815 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 640/1268] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:50 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 1472 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:50:51.612199 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-85fdbf02-c7cc-4a1e-8649-836ca7280aae tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:51.612969 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-85fdbf02-c7cc-4a1e-8649-836ca7280aae tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] [instance: fef24ea0-a934-410a-8440-614ba104efd6] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:50:51.620540 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85fdbf02-c7cc-4a1e-8649-836ca7280aae tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:51.621002 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85fdbf02-c7cc-4a1e-8649-836ca7280aae tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:51.621788 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85fdbf02-c7cc-4a1e-8649-836ca7280aae tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:51.622239 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-85fdbf02-c7cc-4a1e-8649-836ca7280aae tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:51.674052 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-85fdbf02-c7cc-4a1e-8649-836ca7280aae tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] HTTP exception thrown: Instance fef24ea0-a934-410a-8440-614ba104efd6 could not be found. May 25 15:50:51.675189 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-85fdbf02-c7cc-4a1e-8649-836ca7280aae tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Returning 404 to user: Instance fef24ea0-a934-410a-8440-614ba104efd6 could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:50:51.676106 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-85fdbf02-c7cc-4a1e-8649-836ca7280aae tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6" status: 404 len: 111 microversion: 2.1 time: 0.068110 May 25 15:50:51.676645 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 629/1269] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:50:51 2021] GET /compute/v2.1/servers/fef24ea0-a934-410a-8440-614ba104efd6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:50:53.800905 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-63801328-4f2d-4ef1-a080-84c51a6fdfd0 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] Action: 'create', calling method: .version_select at 0x7f088463ce50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2136151463", "metadata": {"Type": "work"}}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:50:53.802339 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-63801328-4f2d-4ef1-a080-84c51a6fdfd0 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:50:53.803145 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-63801328-4f2d-4ef1-a080-84c51a6fdfd0 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.119413 May 25 15:50:53.803681 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 641/1270] 10.222.0.36 () {60 vars in 1156 bytes} [Tue May 25 15:50:53 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 15:50:53.812800 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-efc8c3ea-a9d7-42ae-9565-635ba7e5aca4 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] Action: 'create', calling method: .version_select at 0x7f08846bbca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1462050587", "metadata": {"Type": "work"}}} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:50:53.814257 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-efc8c3ea-a9d7-42ae-9565-635ba7e5aca4 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:50:53.815574 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-efc8c3ea-a9d7-42ae-9565-635ba7e5aca4 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005983 May 25 15:50:53.819831 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 630/1271] 10.222.0.36 () {60 vars in 1156 bytes} [Tue May 25 15:50:53 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 15:50:53.824758 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-423ed5f0-7a90-4877-9ad9-a1cc4ff5862d tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] Action: 'create', calling method: .version_select at 0x7f08848c2e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1894685841", "metadata": {"Type": "work"}}} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:50:53.825942 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-423ed5f0-7a90-4877-9ad9-a1cc4ff5862d tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:50:53.826733 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-423ed5f0-7a90-4877-9ad9-a1cc4ff5862d tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005577 May 25 15:50:53.827234 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 642/1272] 10.222.0.36 () {60 vars in 1156 bytes} [Tue May 25 15:50:53 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 15:50:53.836183 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7c5371e4-c1bc-4b52-b3ed-2e56cc5e74a4 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] Calling method '.version_select at 0x7f08847c3f70>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:53.896220 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-7c5371e4-c1bc-4b52-b3ed-2e56cc5e74a4 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] HTTP exception thrown: Volume tempest-invalid-697948422 could not be found. May 25 15:50:53.896832 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-7c5371e4-c1bc-4b52-b3ed-2e56cc5e74a4 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] Returning 404 to user: Volume tempest-invalid-697948422 could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:50:53.897670 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-7c5371e4-c1bc-4b52-b3ed-2e56cc5e74a4 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-697948422" status: 404 len: 98 microversion: 2.1 time: 0.065064 May 25 15:50:53.898214 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 631/1273] 10.222.0.36 () {58 vars in 1215 bytes} [Tue May 25 15:50:53 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-697948422 => generated 98 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 25 15:50:53.907819 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-265a2527-168b-4446-ac10-97b6e5cff35d tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004341 May 25 15:50:53.908336 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 643/1274] 10.222.0.36 () {58 vars in 1140 bytes} [Tue May 25 15:50:53 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 25 15:50:53.916179 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-34aa5cf5-633a-4233-8096-d0d57453b0a7 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003465 May 25 15:50:53.916675 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 632/1275] 10.222.0.36 () {58 vars in 1137 bytes} [Tue May 25 15:50:53 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 25 15:50:53.925288 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a507d03b-a197-4ec9-9fdb-371ec06ea7d2 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] Calling method '.version_select at 0x7f088519b700>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:53.983568 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-a507d03b-a197-4ec9-9fdb-371ec06ea7d2 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] HTTP exception thrown: Volume 49793d6f-d11d-4b4d-9702-a9536209ed4a could not be found. May 25 15:50:53.984212 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a507d03b-a197-4ec9-9fdb-371ec06ea7d2 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] Returning 404 to user: Volume 49793d6f-d11d-4b4d-9702-a9536209ed4a could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:50:53.985053 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a507d03b-a197-4ec9-9fdb-371ec06ea7d2 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/49793d6f-d11d-4b4d-9702-a9536209ed4a" status: 404 len: 109 microversion: 2.1 time: 0.063626 May 25 15:50:53.985591 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 644/1276] 10.222.0.36 () {58 vars in 1248 bytes} [Tue May 25 15:50:53 2021] DELETE /compute/v2.1/os-volumes/49793d6f-d11d-4b4d-9702-a9536209ed4a => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:50:53.994838 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3cb7384f-2ac1-4a79-a120-b1ec8539ebc0 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] Calling method '.version_select at 0x7f08846bb280>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:50:54.056906 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-3cb7384f-2ac1-4a79-a120-b1ec8539ebc0 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] HTTP exception thrown: Volume 94bd866e-09b6-4031-b180-05c5f0fcb471 could not be found. May 25 15:50:54.057525 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-3cb7384f-2ac1-4a79-a120-b1ec8539ebc0 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] Returning 404 to user: Volume 94bd866e-09b6-4031-b180-05c5f0fcb471 could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:50:54.058369 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-3cb7384f-2ac1-4a79-a120-b1ec8539ebc0 tempest-VolumesNegativeTest-1452824028 tempest-VolumesNegativeTest-1452824028-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/94bd866e-09b6-4031-b180-05c5f0fcb471" status: 404 len: 109 microversion: 2.1 time: 0.067179 May 25 15:50:54.058921 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 633/1277] 10.222.0.36 () {58 vars in 1245 bytes} [Tue May 25 15:50:53 2021] GET /compute/v2.1/os-volumes/94bd866e-09b6-4031-b180-05c5f0fcb471 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:51:57.758080 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:51:57.758785 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: Tue May 25 15:51:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:52:14.198433 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f6875bb-3a29-43e2-a347-230f2ec5e785] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 25 15:52:14.201895 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a2de6859-6340-4dbd-8a06-be7371537e26 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:52:14.202627 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a2de6859-6340-4dbd-8a06-be7371537e26 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:52:14.203046 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8cfd368-3915-4a96-967c-9e88d94a5018] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 25 15:52:14.211053 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a2de6859-6340-4dbd-8a06-be7371537e26 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:14.211559 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a2de6859-6340-4dbd-8a06-be7371537e26 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:14.212383 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a2de6859-6340-4dbd-8a06-be7371537e26 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:14.213721 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-a2de6859-6340-4dbd-8a06-be7371537e26 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:14.278075 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-a2de6859-6340-4dbd-8a06-be7371537e26 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Going to try to terminate instance {{(pid=112577) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:52:14.337827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-b176f7fe-9eb7-4f21-843d-7be558894f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "727f4c83-6a75-4ccf-9f52-c2a83ecca801", "tag": "b62764e4-ba3e-4187-9554-db7555c582f2"}]} {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:52:14.339827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:52:14.339827 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: warnings.warn(msg) May 25 15:52:14.349799 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-b176f7fe-9eb7-4f21-843d-7be558894f16 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:14.350658 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-b176f7fe-9eb7-4f21-843d-7be558894f16 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:14.369760 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.compute.server_external_events [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-b176f7fe-9eb7-4f21-843d-7be558894f16 service nova] Creating event network-changed:b62764e4-ba3e-4187-9554-db7555c582f2 for instance 727f4c83-6a75-4ccf-9f52-c2a83ecca801 on hv-cinder-79123 May 25 15:52:14.375770 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-b176f7fe-9eb7-4f21-843d-7be558894f16 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174523 May 25 15:52:14.376677 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 634/1278] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:52:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:52:14.400288 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a2de6859-6340-4dbd-8a06-be7371537e26 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "DELETE /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 204 len: 0 microversion: 2.1 time: 0.201993 May 25 15:52:14.401625 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 645/1279] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:52:14 2021] DELETE /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:52:14.421964 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:52:14.422699 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:52:14.431194 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:14.431689 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:14.432620 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:14.433110 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:14.817790 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:52:14.830848 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1576 microversion: 2.1 time: 0.424654 May 25 15:52:14.831640 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 635/1280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:52:14 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1576 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:52:15.850103 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-b01d9cd9-e509-4c48-8b70-0e63b1cdddec tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:52:15.850812 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-b01d9cd9-e509-4c48-8b70-0e63b1cdddec tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:52:15.873172 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f6875bb-3a29-43e2-a347-230f2ec5e785] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52828. May 25 15:52:15.876849 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b01d9cd9-e509-4c48-8b70-0e63b1cdddec tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:15.877305 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b01d9cd9-e509-4c48-8b70-0e63b1cdddec tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:15.878084 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b01d9cd9-e509-4c48-8b70-0e63b1cdddec tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:15.878526 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-b01d9cd9-e509-4c48-8b70-0e63b1cdddec tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:16.077736 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-b01d9cd9-e509-4c48-8b70-0e63b1cdddec tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:52:16.087521 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-b01d9cd9-e509-4c48-8b70-0e63b1cdddec tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1458 microversion: 2.1 time: 0.241612 May 25 15:52:16.088114 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 646/1281] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:52:15 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1458 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:52:17.104254 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-692a1ef3-7c4d-4128-9e39-44a0ded005dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:52:17.105073 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-692a1ef3-7c4d-4128-9e39-44a0ded005dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:52:17.124047 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-692a1ef3-7c4d-4128-9e39-44a0ded005dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:17.124613 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-692a1ef3-7c4d-4128-9e39-44a0ded005dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:17.125489 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-692a1ef3-7c4d-4128-9e39-44a0ded005dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:17.126014 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-692a1ef3-7c4d-4128-9e39-44a0ded005dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:17.188928 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8cfd368-3915-4a96-967c-9e88d94a5018] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52836. May 25 15:52:17.225531 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-dabbd625-3531-46cf-aa3a-e6bebe4bc3c2 req-e4983dac-d7e8-4735-84ff-902a62ce924d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "727f4c83-6a75-4ccf-9f52-c2a83ecca801", "name": "network-vif-deleted", "tag": "b62764e4-ba3e-4187-9554-db7555c582f2"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:52:17.227804 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:52:17.227804 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:52:17.236803 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-dabbd625-3531-46cf-aa3a-e6bebe4bc3c2 req-e4983dac-d7e8-4735-84ff-902a62ce924d service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:17.237492 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-dabbd625-3531-46cf-aa3a-e6bebe4bc3c2 req-e4983dac-d7e8-4735-84ff-902a62ce924d service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:17.252673 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-692a1ef3-7c4d-4128-9e39-44a0ded005dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:52:17.254149 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-dabbd625-3531-46cf-aa3a-e6bebe4bc3c2 req-e4983dac-d7e8-4735-84ff-902a62ce924d service nova] Creating event network-vif-deleted:b62764e4-ba3e-4187-9554-db7555c582f2 for instance 727f4c83-6a75-4ccf-9f52-c2a83ecca801 on hv-cinder-79123 May 25 15:52:17.259229 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-dabbd625-3531-46cf-aa3a-e6bebe4bc3c2 req-e4983dac-d7e8-4735-84ff-902a62ce924d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037250 May 25 15:52:17.260352 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 647/1282] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:52:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:52:17.261759 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-692a1ef3-7c4d-4128-9e39-44a0ded005dd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 200 len: 1390 microversion: 2.1 time: 0.161266 May 25 15:52:17.262565 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 636/1283] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:52:17 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:52:18.279173 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-26b5ba24-560c-4a69-8fc7-5db2cd780089 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:52:18.279918 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-26b5ba24-560c-4a69-8fc7-5db2cd780089 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 727f4c83-6a75-4ccf-9f52-c2a83ecca801] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:52:18.288058 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-26b5ba24-560c-4a69-8fc7-5db2cd780089 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:18.288560 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-26b5ba24-560c-4a69-8fc7-5db2cd780089 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:18.289881 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-26b5ba24-560c-4a69-8fc7-5db2cd780089 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:18.290693 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-26b5ba24-560c-4a69-8fc7-5db2cd780089 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:18.346952 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-26b5ba24-560c-4a69-8fc7-5db2cd780089 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] HTTP exception thrown: Instance 727f4c83-6a75-4ccf-9f52-c2a83ecca801 could not be found. May 25 15:52:18.347949 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-26b5ba24-560c-4a69-8fc7-5db2cd780089 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Returning 404 to user: Instance 727f4c83-6a75-4ccf-9f52-c2a83ecca801 could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:52:18.348818 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-26b5ba24-560c-4a69-8fc7-5db2cd780089 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801" status: 404 len: 111 microversion: 2.1 time: 0.073894 May 25 15:52:18.349390 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 648/1284] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:52:18 2021] GET /compute/v2.1/servers/727f4c83-6a75-4ccf-9f52-c2a83ecca801 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:52:22.249709 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-132a90d3-2c84-4d07-b3d7-426ca6b89458 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:52:22.255819 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-3b8fee0b-4fc4-4b44-8435-b6f5459ac1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872c3577-4aec-4d1b-bcba-583bdbea50cb", "tag": "241b07d8-fed4-43ac-a7e1-530b98daf731"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:52:22.257512 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:52:22.257512 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:52:22.260581 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-132a90d3-2c84-4d07-b3d7-426ca6b89458 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:52:22.271445 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-132a90d3-2c84-4d07-b3d7-426ca6b89458 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:22.271944 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-132a90d3-2c84-4d07-b3d7-426ca6b89458 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:22.272754 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-132a90d3-2c84-4d07-b3d7-426ca6b89458 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:22.273200 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-132a90d3-2c84-4d07-b3d7-426ca6b89458 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:22.283511 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-3b8fee0b-4fc4-4b44-8435-b6f5459ac1d0 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:22.284116 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-3b8fee0b-4fc4-4b44-8435-b6f5459ac1d0 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:22.300127 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-3b8fee0b-4fc4-4b44-8435-b6f5459ac1d0 service nova] Creating event network-changed:241b07d8-fed4-43ac-a7e1-530b98daf731 for instance 872c3577-4aec-4d1b-bcba-583bdbea50cb on hv-cinder-79123 May 25 15:52:22.305690 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-3b8fee0b-4fc4-4b44-8435-b6f5459ac1d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053060 May 25 15:52:22.306808 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 649/1285] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:52:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:52:22.362816 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-132a90d3-2c84-4d07-b3d7-426ca6b89458 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Going to try to terminate instance {{(pid=112576) delete /opt/stack/nova/nova/compute/api.py:2539}} May 25 15:52:22.513623 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-132a90d3-2c84-4d07-b3d7-426ca6b89458 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "DELETE /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 204 len: 0 microversion: 2.1 time: 0.267103 May 25 15:52:22.514887 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 637/1286] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:52:22 2021] DELETE /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:52:22.523759 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-5626412f-939f-48e1-995c-5d01f37d46f2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:52:22.524520 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-5626412f-939f-48e1-995c-5d01f37d46f2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:52:22.533765 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5626412f-939f-48e1-995c-5d01f37d46f2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:22.534234 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5626412f-939f-48e1-995c-5d01f37d46f2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:22.535031 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5626412f-939f-48e1-995c-5d01f37d46f2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:22.535473 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-5626412f-939f-48e1-995c-5d01f37d46f2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:22.945543 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.policy [None req-5626412f-939f-48e1-995c-5d01f37d46f2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112577) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:52:22.954326 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-5626412f-939f-48e1-995c-5d01f37d46f2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1577 microversion: 2.1 time: 0.434705 May 25 15:52:22.954905 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 650/1287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:52:22 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1577 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:52:23.972498 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-bb269448-7d9c-44a0-a62c-7f19abb1f85d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:52:23.973213 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-bb269448-7d9c-44a0-a62c-7f19abb1f85d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:52:23.982004 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bb269448-7d9c-44a0-a62c-7f19abb1f85d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:23.982467 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bb269448-7d9c-44a0-a62c-7f19abb1f85d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:23.983323 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bb269448-7d9c-44a0-a62c-7f19abb1f85d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:23.983768 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-bb269448-7d9c-44a0-a62c-7f19abb1f85d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:24.200699 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.policy [None req-bb269448-7d9c-44a0-a62c-7f19abb1f85d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082a0ad3211940cda30d219bb251e2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=112576) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:52:24.212795 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-bb269448-7d9c-44a0-a62c-7f19abb1f85d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 200 len: 1459 microversion: 2.1 time: 0.244484 May 25 15:52:24.213713 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 638/1288] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:52:23 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 1459 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:52:24.374700 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [req-68f9d8d7-352c-4c9a-857a-e65e03107e06 req-2467b23d-2796-4fb3-9a65-2d5e817ec021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872c3577-4aec-4d1b-bcba-583bdbea50cb", "name": "network-vif-deleted", "tag": "241b07d8-fed4-43ac-a7e1-530b98daf731"}]} {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:52:24.376473 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:52:24.376473 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: warnings.warn(msg) May 25 15:52:24.385046 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-68f9d8d7-352c-4c9a-857a-e65e03107e06 req-2467b23d-2796-4fb3-9a65-2d5e817ec021 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:24.385504 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [req-68f9d8d7-352c-4c9a-857a-e65e03107e06 req-2467b23d-2796-4fb3-9a65-2d5e817ec021 service nova] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:24.402283 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.compute.server_external_events [req-68f9d8d7-352c-4c9a-857a-e65e03107e06 req-2467b23d-2796-4fb3-9a65-2d5e817ec021 service nova] Creating event network-vif-deleted:241b07d8-fed4-43ac-a7e1-530b98daf731 for instance 872c3577-4aec-4d1b-bcba-583bdbea50cb on hv-cinder-79123 May 25 15:52:24.406840 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [req-68f9d8d7-352c-4c9a-857a-e65e03107e06 req-2467b23d-2796-4fb3-9a65-2d5e817ec021 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036120 May 25 15:52:24.407715 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 651/1289] 10.222.0.36 () {64 vars in 1318 bytes} [Tue May 25 15:52:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:52:25.231014 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e1d97de1-d802-4ab6-adbe-efe84d05729a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:52:25.231570 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-e1d97de1-d802-4ab6-adbe-efe84d05729a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 872c3577-4aec-4d1b-bcba-583bdbea50cb] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:52:25.238997 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e1d97de1-d802-4ab6-adbe-efe84d05729a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:25.239459 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e1d97de1-d802-4ab6-adbe-efe84d05729a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:25.240596 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e1d97de1-d802-4ab6-adbe-efe84d05729a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:25.241181 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-e1d97de1-d802-4ab6-adbe-efe84d05729a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:25.294447 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-e1d97de1-d802-4ab6-adbe-efe84d05729a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] HTTP exception thrown: Instance 872c3577-4aec-4d1b-bcba-583bdbea50cb could not be found. May 25 15:52:25.295115 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-e1d97de1-d802-4ab6-adbe-efe84d05729a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Returning 404 to user: Instance 872c3577-4aec-4d1b-bcba-583bdbea50cb could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:52:25.296110 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-e1d97de1-d802-4ab6-adbe-efe84d05729a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb" status: 404 len: 111 microversion: 2.1 time: 0.069804 May 25 15:52:25.296677 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 639/1290] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:52:25 2021] GET /compute/v2.1/servers/872c3577-4aec-4d1b-bcba-583bdbea50cb => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:52:26.030947 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-644e1c5c-f619-48ac-b4e0-c06e16ee4932 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:52:26.031552 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.compute.api [None req-644e1c5c-f619-48ac-b4e0-c06e16ee4932 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112577) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:52:26.038998 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-644e1c5c-f619-48ac-b4e0-c06e16ee4932 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:26.040065 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-644e1c5c-f619-48ac-b4e0-c06e16ee4932 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:26.040846 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-644e1c5c-f619-48ac-b4e0-c06e16ee4932 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:26.041296 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG oslo_concurrency.lockutils [None req-644e1c5c-f619-48ac-b4e0-c06e16ee4932 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:26.092356 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.wsgi [None req-644e1c5c-f619-48ac-b4e0-c06e16ee4932 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] HTTP exception thrown: Instance 4cd52975-28c3-4fb7-ada2-905a8a9c571f could not be found. May 25 15:52:26.092975 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-644e1c5c-f619-48ac-b4e0-c06e16ee4932 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Returning 404 to user: Instance 4cd52975-28c3-4fb7-ada2-905a8a9c571f could not be found. {{(pid=112577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:52:26.093825 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-644e1c5c-f619-48ac-b4e0-c06e16ee4932 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 404 len: 111 microversion: 2.1 time: 0.067314 May 25 15:52:26.094382 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 652/1291] 10.222.0.36 () {58 vars in 1239 bytes} [Tue May 25 15:52:26 2021] DELETE /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:52:26.102977 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f8c7918a-ff1c-48fc-992a-f3219e43273f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '>' {{(pid=112576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:52:26.103608 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.compute.api [None req-f8c7918a-ff1c-48fc-992a-f3219e43273f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] [instance: 4cd52975-28c3-4fb7-ada2-905a8a9c571f] Fetching instance by UUID {{(pid=112576) get /opt/stack/nova/nova/compute/api.py:2790}} May 25 15:52:26.110868 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f8c7918a-ff1c-48fc-992a-f3219e43273f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:26.111328 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f8c7918a-ff1c-48fc-992a-f3219e43273f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:26.112152 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f8c7918a-ff1c-48fc-992a-f3219e43273f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:26.112601 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG oslo_concurrency.lockutils [None req-f8c7918a-ff1c-48fc-992a-f3219e43273f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "9d361204-4d46-4b6e-978b-1951a5dab06b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:26.161488 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.wsgi [None req-f8c7918a-ff1c-48fc-992a-f3219e43273f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] HTTP exception thrown: Instance 4cd52975-28c3-4fb7-ada2-905a8a9c571f could not be found. May 25 15:52:26.162102 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: DEBUG nova.api.openstack.wsgi [None req-f8c7918a-ff1c-48fc-992a-f3219e43273f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Returning 404 to user: Instance 4cd52975-28c3-4fb7-ada2-905a8a9c571f could not be found. {{(pid=112576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 25 15:52:26.162947 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO nova.api.openstack.requestlog [None req-f8c7918a-ff1c-48fc-992a-f3219e43273f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f" status: 404 len: 111 microversion: 2.1 time: 0.064297 May 25 15:52:26.163504 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: [pid: 112576|app: 0|req: 640/1292] 10.222.0.36 () {58 vars in 1236 bytes} [Tue May 25 15:52:26 2021] GET /compute/v2.1/servers/4cd52975-28c3-4fb7-ada2-905a8a9c571f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:52:27.610515 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: DEBUG nova.api.openstack.wsgi [None req-a6e4297d-c2a1-417a-a8db-205d5d004877 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling method '.version_select at 0x7f08859fb700>' {{(pid=112577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:52:27.630149 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO nova.api.openstack.requestlog [None req-a6e4297d-c2a1-417a-a8db-205d5d004877 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-980388926" status: 202 len: 0 microversion: 2.1 time: 0.024688 May 25 15:52:27.630718 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: [pid: 112577|app: 0|req: 653/1293] 10.222.0.36 () {58 vars in 1260 bytes} [Tue May 25 15:52:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-980388926 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:54:56.024037 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:54:56.024543 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: Tue May 25 15:54:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:55:00.655685 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:55:00.656303 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: Tue May 25 15:55:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:55:17.229059 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:55:17.229790 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: Tue May 25 15:55:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:55:17.748611 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:55:17.748832 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: Tue May 25 15:55:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:55:17.775708 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:55:17.776284 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: Tue May 25 15:55:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:55:28.424767 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:55:28.425445 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: Tue May 25 15:55:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:58:16.042114 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:58:16.042874 dv-cinder-791239-3-iscsi devstack@n-api.service[112576]: Tue May 25 15:58:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:58:20.673848 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:58:20.674545 dv-cinder-791239-3-iscsi devstack@n-api.service[112577]: Tue May 25 15:58:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!